2024-03-18T17:55:21.648 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-18T17:55:21.648 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205 --owner scheduled_yuriw@teuthology --verbose --name yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} -- /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/orig.config.yaml 2024-03-18T17:55:21.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T17:55:21.782 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205 branch: wip-yuri10-testing-2024-03-15-1653-reef description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} email: yweinste@redhat.com first_in_suite: false job_id: '7606205' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri10-testing-2024-03-15-1653-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 49bdc51142759622a281d3e5327eebd07cbb8bb3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 49bdc51142759622a281d3e5327eebd07cbb8bb3 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2024-03-15-1653-reef sha1: 49bdc51142759622a281d3e5327eebd07cbb8bb3 owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 8313 sha1: 49bdc51142759622a281d3e5327eebd07cbb8bb3 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri10-testing-2024-03-15-1653-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 49bdc51142759622a281d3e5327eebd07cbb8bb3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - check-counter: counters: mds: - mds.dir_split - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-16_15:03:17 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-18T17:55:21.782 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa; will attempt to use it 2024-03-18T17:55:21.783 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa/tasks 2024-03-18T17:55:21.783 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-18T17:55:21.785 INFO:teuthology.task.internal:Checking packages... 2024-03-18T17:55:21.811 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '49bdc51142759622a281d3e5327eebd07cbb8bb3' 2024-03-18T17:55:21.811 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T17:55:21.811 INFO:teuthology.packaging:ref: None 2024-03-18T17:55:21.811 INFO:teuthology.packaging:tag: None 2024-03-18T17:55:21.811 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-03-15-1653-reef 2024-03-18T17:55:21.811 INFO:teuthology.packaging:sha1: 49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T17:55:21.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri10-testing-2024-03-15-1653-reef 2024-03-18T17:55:22.039 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-914-g49bdc511-1focal 2024-03-18T17:55:22.040 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-18T17:55:22.047 INFO:teuthology.task.internal:no buildpackages task found 2024-03-18T17:55:22.048 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-18T17:55:22.063 INFO:teuthology.task.internal:Saving configuration 2024-03-18T17:55:22.079 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-18T17:55:22.085 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T17:55:22.109 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 17:44:44.748949', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-03-18T17:55:22.132 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 17:44:44.750073', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-03-18T17:55:22.132 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-18T17:55:22.138 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-18T17:55:22.139 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-18T17:55:22.139 INFO:teuthology.run_tasks:Running task console_log... 2024-03-18T17:55:22.221 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8d60713a0>, signals=[15]) 2024-03-18T17:55:22.221 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-18T17:55:22.227 INFO:teuthology.task.internal:Opening connections... 2024-03-18T17:55:22.228 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T17:55:22.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:55:22.328 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T17:55:22.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:55:22.415 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-18T17:55:22.422 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-03-18T17:55:22.428 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-03-18T17:55:22.429 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-03-18T17:55:22.477 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="20.04" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-18T17:55:22.478 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-18T17:55:22.479 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=focal 2024-03-18T17:55:22.479 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=focal 2024-03-18T17:55:22.479 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-03-18T17:55:22.503 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-03-18T17:55:22.509 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-03-18T17:55:22.510 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-03-18T17:55:22.558 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-03-18T17:55:22.558 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-18T17:55:22.559 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-18T17:55:22.560 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2024-03-18T17:55:22.560 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2024-03-18T17:55:22.560 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-03-18T17:55:22.578 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-18T17:55:22.588 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-18T17:55:22.595 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-18T17:55:22.596 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-03-18T17:55:22.598 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-03-18T17:55:22.603 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-18T17:55:22.612 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-18T17:55:22.612 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-03-18T17:55:22.615 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-03-18T17:55:22.635 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-18T17:55:22.691 INFO:teuthology.run_tasks:Running task kernel... 2024-03-18T17:55:22.740 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-18T17:55:22.740 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-18T17:55:22.740 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T17:55:22.741 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T17:55:22.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T17:55:22.746 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-03-18T17:55:22.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T17:55:22.747 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-03-18T17:55:22.753 INFO:teuthology.orchestra.run.smithi094.stdout:5.4.0-124-generic 2024-03-18T17:55:22.754 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.4.0-124-generic 2024-03-18T17:55:22.754 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-03-18T17:55:22.755 INFO:teuthology.orchestra.run.smithi151.stdout:5.4.0-124-generic 2024-03-18T17:55:22.755 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.4.0-124-generic 2024-03-18T17:55:22.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-03-18T17:55:22.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-03-18T17:55:22.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-03-18T17:55:23.072 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-03-18T17:55:23.171 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-03-18T17:55:23.180 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-03-18T17:55:23.180 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-03-18T17:55:23.244 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-03-18T17:55:23.253 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-03-18T17:55:23.370 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [720 kB] 2024-03-18T17:55:23.476 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,779 kB] 2024-03-18T17:55:23.533 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [421 kB] 2024-03-18T17:55:23.538 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-03-18T17:55:23.538 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,638 kB] 2024-03-18T17:55:23.573 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.0 kB] 2024-03-18T17:55:23.575 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [368 kB] 2024-03-18T17:55:23.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-03-18T17:55:23.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [654 kB] 2024-03-18T17:55:23.592 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [950 kB] 2024-03-18T17:55:23.604 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [200 kB] 2024-03-18T17:55:23.607 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-03-18T17:55:23.610 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-03-18T17:55:23.613 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-03-18T17:55:23.614 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-03-18T17:55:23.614 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-03-18T17:55:23.614 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-03-18T17:55:23.622 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-03-18T17:55:23.662 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [720 kB] 2024-03-18T17:55:23.778 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,177 kB] 2024-03-18T17:55:23.797 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,177 kB] 2024-03-18T17:55:24.244 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,779 kB] 2024-03-18T17:55:24.418 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [949 kB] 2024-03-18T17:55:24.462 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [506 kB] 2024-03-18T17:55:24.475 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-03-18T17:55:24.476 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,784 kB] 2024-03-18T17:55:24.588 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [949 kB] 2024-03-18T17:55:24.658 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [421 kB] 2024-03-18T17:55:24.707 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-03-18T17:55:24.707 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.0 kB] 2024-03-18T17:55:24.708 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,638 kB] 2024-03-18T17:55:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.3 kB] 2024-03-18T17:55:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [389 kB] 2024-03-18T17:55:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-03-18T17:55:24.754 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [506 kB] 2024-03-18T17:55:24.787 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [368 kB] 2024-03-18T17:55:24.795 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-03-18T17:55:24.795 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [654 kB] 2024-03-18T17:55:24.813 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-03-18T17:55:24.814 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [950 kB] 2024-03-18T17:55:24.814 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.3 kB] 2024-03-18T17:55:24.817 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,784 kB] 2024-03-18T17:55:24.898 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [781 kB] 2024-03-18T17:55:25.014 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [200 kB] 2024-03-18T17:55:25.222 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [389 kB] 2024-03-18T17:55:25.262 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-03-18T17:55:25.433 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [781 kB] 2024-03-18T17:55:25.464 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-03-18T17:55:25.470 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-03-18T17:55:25.473 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.9 kB] 2024-03-18T17:55:25.542 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,796 B] 2024-03-18T17:55:25.560 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-03-18T17:55:25.762 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,177 kB] 2024-03-18T17:55:25.977 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [282 kB] 2024-03-18T17:55:25.996 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-03-18T17:55:26.002 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-03-18T17:55:26.007 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-03-18T17:55:26.009 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-03-18T17:55:26.009 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-03-18T17:55:26.010 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-03-18T17:55:26.023 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-03-18T17:55:26.025 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-03-18T17:55:26.190 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-03-18T17:55:26.231 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,177 kB] 2024-03-18T17:55:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-03-18T17:55:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-03-18T17:55:26.443 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [282 kB] 2024-03-18T17:55:26.488 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-03-18T17:55:26.498 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.1 kB] 2024-03-18T17:55:26.499 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-03-18T17:55:26.505 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,768 B] 2024-03-18T17:55:26.505 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-03-18T17:55:26.505 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-03-18T17:55:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-03-18T17:55:26.530 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-03-18T17:55:26.694 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-03-18T17:55:26.882 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-03-18T17:55:26.902 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-03-18T17:55:28.306 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 19.5 MB in 3s (5,670 kB/s) 2024-03-18T17:55:28.872 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 19.5 MB in 4s (4,901 kB/s) 2024-03-18T17:55:29.852 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T17:55:29.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-18T17:55:29.949 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T17:55:30.160 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-03-18T17:55:30.160 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-03-18T17:55:30.324 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T17:55:30.348 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-18T17:55:30.349 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-03-18T17:55:30.349 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.4.0-174 linux-headers-5.4.0-174-generic 2024-03-18T17:55:30.349 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.4.0-174-generic 2024-03-18T17:55:30.350 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.4.0-174-generic linux-modules-extra-5.4.0-174-generic 2024-03-18T17:55:30.351 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-03-18T17:55:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-03-18T17:55:30.351 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-03-18T17:55:30.351 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-03-18T17:55:30.402 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-03-18T17:55:30.402 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.4.0-174 linux-headers-5.4.0-174-generic 2024-03-18T17:55:30.402 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-174-generic linux-modules-5.4.0-174-generic 2024-03-18T17:55:30.403 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.4.0-174-generic 2024-03-18T17:55:30.404 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-03-18T17:55:30.404 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-18T17:55:30.417 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T17:55:30.467 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 295 not upgraded. 2024-03-18T17:55:30.467 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 77.1 MB of archives. 2024-03-18T17:55:30.467 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 380 MB of additional disk space will be used. 2024-03-18T17:55:30.468 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-174-generic amd64 5.4.0-174.193 [15.0 MB] 2024-03-18T17:55:30.628 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-03-18T17:55:30.629 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-03-18T17:55:30.823 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-03-18T17:55:30.824 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-5.4.0-174 linux-headers-5.4.0-174-generic 2024-03-18T17:55:30.824 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-generic linux-image-5.4.0-174-generic 2024-03-18T17:55:30.824 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-5.4.0-174-generic linux-modules-extra-5.4.0-174-generic 2024-03-18T17:55:30.825 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-03-18T17:55:30.825 INFO:teuthology.orchestra.run.smithi094.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-03-18T17:55:30.825 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-03-18T17:55:30.825 INFO:teuthology.orchestra.run.smithi094.stdout: thermald 2024-03-18T17:55:30.887 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-03-18T17:55:30.887 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-5.4.0-174 linux-headers-5.4.0-174-generic 2024-03-18T17:55:30.887 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-174-generic linux-modules-5.4.0-174-generic 2024-03-18T17:55:30.887 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-extra-5.4.0-174-generic 2024-03-18T17:55:30.888 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-03-18T17:55:30.889 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-18T17:55:30.993 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-174-generic amd64 5.4.0-174.193 [10.5 MB] 2024-03-18T17:55:31.071 INFO:teuthology.orchestra.run.smithi094.stdout:3 upgraded, 5 newly installed, 0 to remove and 295 not upgraded. 2024-03-18T17:55:31.071 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 77.1 MB of archives. 2024-03-18T17:55:31.071 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 380 MB of additional disk space will be used. 2024-03-18T17:55:31.071 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-174-generic amd64 5.4.0-174.193 [15.0 MB] 2024-03-18T17:55:31.172 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-174-generic amd64 5.4.0-174.193 [39.2 MB] 2024-03-18T17:55:32.110 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.174.172 [1,900 B] 2024-03-18T17:55:32.111 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.174.172 [2,564 B] 2024-03-18T17:55:32.111 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-174 all 5.4.0-174.193 [11.0 MB] 2024-03-18T17:55:32.236 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-174-generic amd64 5.4.0-174.193 [10.5 MB] 2024-03-18T17:55:32.284 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-174-generic amd64 5.4.0-174.193 [1,385 kB] 2024-03-18T17:55:32.312 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.174.172 [2,436 B] 2024-03-18T17:55:32.551 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-174-generic amd64 5.4.0-174.193 [39.2 MB] 2024-03-18T17:55:32.977 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 77.1 MB in 2s (40.6 MB/s) 2024-03-18T17:55:33.138 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.4.0-174-generic. 2024-03-18T17:55:33.815 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.174.172 [1,900 B] 2024-03-18T17:55:33.815 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.174.172 [2,564 B] 2024-03-18T17:55:33.815 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-174 all 5.4.0-174.193 [11.0 MB] 2024-03-18T17:55:34.478 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-174-generic amd64 5.4.0-174.193 [1,385 kB] 2024-03-18T17:55:34.549 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.174.172 [2,436 B] 2024-03-18T17:55:35.014 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-03-18T17:55:35.019 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:35.129 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:35.217 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 77.1 MB in 4s (21.1 MB/s) 2024-03-18T17:55:35.437 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-5.4.0-174-generic. 2024-03-18T17:55:37.008 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.4.0-174-generic. 2024-03-18T17:55:37.022 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:37.125 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:37.203 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-03-18T17:55:37.207 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../0-linux-modules-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:37.309 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:38.173 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-174-generic. 2024-03-18T17:55:38.184 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:38.250 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:39.574 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-image-5.4.0-174-generic. 2024-03-18T17:55:39.591 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../1-linux-image-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:39.679 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:40.795 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-174-generic. 2024-03-18T17:55:40.811 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:40.856 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-extra-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:43.022 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.4.0.174.172_amd64.deb ... 2024-03-18T17:55:43.156 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.4.0.174.172) over (5.4.0.124.125) ... 2024-03-18T17:55:43.526 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.174.172_amd64.deb ... 2024-03-18T17:55:43.655 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.4.0.174.172) over (5.4.0.124.125) ... 2024-03-18T17:55:44.008 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.4.0-174. 2024-03-18T17:55:44.022 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.4.0-174_5.4.0-174.193_all.deb ... 2024-03-18T17:55:44.066 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.4.0-174 (5.4.0-174.193) ... 2024-03-18T17:55:45.822 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../3-linux-generic_5.4.0.174.172_amd64.deb ... 2024-03-18T17:55:45.948 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-generic (5.4.0.174.172) over (5.4.0.124.125) ... 2024-03-18T17:55:46.274 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.174.172_amd64.deb ... 2024-03-18T17:55:46.410 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-generic (5.4.0.174.172) over (5.4.0.124.125) ... 2024-03-18T17:55:46.755 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.4.0-174. 2024-03-18T17:55:46.769 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../5-linux-headers-5.4.0-174_5.4.0-174.193_all.deb ... 2024-03-18T17:55:46.813 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.4.0-174 (5.4.0-174.193) ... 2024-03-18T17:55:49.331 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.4.0-174-generic. 2024-03-18T17:55:49.352 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:49.406 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:52.104 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.174.172_amd64.deb ... 2024-03-18T17:55:52.252 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.4.0.174.172) over (5.4.0.124.125) ... 2024-03-18T17:55:52.349 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.4.0-174-generic. 2024-03-18T17:55:52.372 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../6-linux-headers-5.4.0-174-generic_5.4.0-174.193_amd64.deb ... 2024-03-18T17:55:52.415 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:52.579 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:53.853 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:55.148 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.174.172_amd64.deb ... 2024-03-18T17:55:55.283 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-174-generic 2024-03-18T17:55:55.283 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-174-generic 2024-03-18T17:55:55.292 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-generic (5.4.0.174.172) over (5.4.0.124.125) ... 2024-03-18T17:55:55.630 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:55.914 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:56.851 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:57.100 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.4.0-174 (5.4.0-174.193) ... 2024-03-18T17:55:57.226 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:57.377 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.4.0.174.172) ... 2024-03-18T17:55:57.504 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.4.0.174.172) ... 2024-03-18T17:55:57.655 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.4.0.174.172) ... 2024-03-18T17:55:57.815 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:57.887 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-18T17:55:57.887 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-174-generic 2024-03-18T17:55:58.012 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-174-generic 2024-03-18T17:55:58.012 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-174-generic 2024-03-18T17:55:58.153 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-extra-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:59.330 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.4.0-174 (5.4.0-174.193) ... 2024-03-18T17:55:59.448 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:55:59.832 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-generic (5.4.0.174.172) ... 2024-03-18T17:56:01.498 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-generic (5.4.0.174.172) ... 2024-03-18T17:56:01.643 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-generic (5.4.0.174.172) ... 2024-03-18T17:56:01.770 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for linux-image-5.4.0-174-generic (5.4.0-174.193) ... 2024-03-18T17:56:01.841 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-18T17:56:01.841 INFO:teuthology.orchestra.run.smithi094.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-174-generic 2024-03-18T17:56:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-18T17:56:19.419 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-03-18T17:56:19.432 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-18T17:56:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-03-18T17:56:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-174-generic 2024-03-18T17:56:19.783 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-174-generic 2024-03-18T17:56:20.189 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-03-18T17:56:20.201 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-03-18T17:56:22.865 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-03-18T17:56:23.288 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-03-18T17:56:23.340 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-03-18T17:56:23.341 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 20 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.4.0.174.172 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: virtualbox-guest-modules (= 6.1.48-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.4.0-174-generic, linux-modules-extra-5.4.0-174-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-03-18T17:56:23.342 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-03-18T17:56:23.343 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-174-generic 2024-03-18T17:56:23.343 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T17:56:23.343 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T17:56:23.343 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-18T17:56:23.343 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T17:56:23.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-03-18T17:56:23.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-03-18T17:56:23.683 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-03-18T17:56:23.684 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-03-18T17:56:23.754 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-03-18T17:56:23.839 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-03-18T17:56:23.949 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-18T17:56:23.949 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub' 2024-03-18T17:56:23.963 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-18T17:56:23.980 INFO:teuthology.orchestra.run.smithi094.stdout:Generating grub configuration file ... 2024-03-18T17:56:24.329 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-174-generic 2024-03-18T17:56:24.354 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-174-generic 2024-03-18T17:56:24.728 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-03-18T17:56:24.741 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-03-18T17:56:25.499 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T17:56:25.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-18T17:56:25.592 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T17:56:25.793 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-03-18T17:56:25.794 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-03-18T17:56:26.012 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.4.0.174.172). 2024-03-18T17:56:26.012 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 295 not upgraded. 2024-03-18T17:56:26.014 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 20 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.4.0.174.172 2024-03-18T17:56:26.037 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: virtualbox-guest-modules (= 6.1.48-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-03-18T17:56:26.038 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.4.0-174-generic, linux-modules-extra-5.4.0-174-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-18T17:56:26.038 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-03-18T17:56:26.038 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-03-18T17:56:26.038 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-03-18T17:56:26.038 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-03-18T17:56:26.038 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-03-18T17:56:26.087 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.wZkFWnSRv3 2024-03-18T17:56:26.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wZkFWnSRv3 2024-03-18T17:56:26.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.wZkFWnSRv3 2024-03-18T17:56:26.139 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.wZkFWnSRv3 is 9KB 2024-03-18T17:56:26.152 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.wZkFWnSRv3 2024-03-18T17:56:26.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-18T17:56:26.215 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T17:56:26.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-18T17:56:26.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-18T17:56:26.252 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-174-generic 2024-03-18T17:56:26.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-03-18T17:56:27.340 INFO:teuthology.orchestra.run.smithi094.stdout:done 2024-03-18T17:56:27.654 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-03-18T17:56:27.664 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-18T17:56:27.673 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-03-18T17:56:27.757 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-03-18T17:56:27.805 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-03-18T17:56:27.805 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-03-18T17:56:27.806 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-03-18T17:56:27.806 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-03-18T17:56:27.806 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 20 2024-03-18T17:56:27.806 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.4.0.174.172 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: virtualbox-guest-modules (= 6.1.48-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.4.0-174-generic, linux-modules-extra-5.4.0-174-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-03-18T17:56:27.811 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-03-18T17:56:27.812 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-03-18T17:56:27.812 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-174-generic 2024-03-18T17:56:27.812 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T17:56:27.812 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T17:56:27.812 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-18T17:56:27.812 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T17:56:27.812 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-03-18T17:56:27.902 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-03-18T17:56:27.924 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-174-generic 2024-03-18T17:56:27.935 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-174-generic 2024-03-18T17:56:28.070 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-03-18T17:56:28.101 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-03-18T17:56:28.143 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-03-18T17:56:28.161 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-03-18T17:56:28.296 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-03-18T17:56:28.308 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-03-18T17:56:29.870 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T17:56:29.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-18T17:56:29.967 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T17:56:29.971 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-03-18T17:56:29.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-03-18T17:56:30.153 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-03-18T17:56:30.154 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-03-18T17:56:30.376 INFO:teuthology.orchestra.run.smithi094.stdout:linux-image-generic is already the newest version (5.4.0.174.172). 2024-03-18T17:56:30.376 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 0 newly installed, 0 to remove and 295 not upgraded. 2024-03-18T17:56:30.379 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-03-18T17:56:30.396 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-03-18T17:56:30.396 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-03-18T17:56:30.396 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-03-18T17:56:30.396 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-03-18T17:56:30.396 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 20 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.4.0.174.172 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: virtualbox-guest-modules (= 6.1.48-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.4.0-174-generic, linux-modules-extra-5.4.0-174-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-03-18T17:56:30.397 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-03-18T17:56:30.397 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-03-18T17:56:30.445 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.J88NeZVayT 2024-03-18T17:56:30.446 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.J88NeZVayT 2024-03-18T17:56:30.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.J88NeZVayT 2024-03-18T17:56:30.509 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.J88NeZVayT is 9KB 2024-03-18T17:56:30.523 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.J88NeZVayT 2024-03-18T17:56:30.530 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-18T17:56:30.584 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T17:56:30.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-18T17:56:30.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-18T17:56:30.618 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-174-generic 2024-03-18T17:56:30.618 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-grub 2024-03-18T17:56:31.998 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub' 2024-03-18T17:56:32.037 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-18T17:56:32.046 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-03-18T17:56:32.322 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-174-generic 2024-03-18T17:56:32.333 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-174-generic 2024-03-18T17:56:32.697 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-03-18T17:56:32.709 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-03-18T17:56:34.306 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-03-18T17:56:34.308 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-03-18T17:57:00.001 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-18T17:57:00.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T17:57:00.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:57:04.314 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-18T17:57:04.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-18T17:57:04.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:57:18.499 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-18T17:57:22.847 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-18T17:57:27.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T17:57:27.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:57:30.558 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-18T17:57:31.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-18T17:57:31.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:57:34.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-03-18T17:57:42.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T17:57:42.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:57:46.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-18T17:57:46.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:58:18.658 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-03-18T17:58:19.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-18T17:58:19.194 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-174-generic"... 2024-03-18T17:58:19.194 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-03-18T17:58:19.200 INFO:teuthology.orchestra.run.smithi094.stdout:5.4.0-174-generic 2024-03-18T17:58:19.201 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-174-generic vs 5.4.0-174-generic 2024-03-18T17:58:19.201 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T17:58:19.201 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-18T17:58:20.202 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-18T17:58:20.202 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-18T17:58:20.301 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-03-18T17:58:20.324 DEBUG:teuthology.parallel:result is None 2024-03-18T17:58:42.570 DEBUG:teuthology.orchestra.remote:timed out 2024-03-18T17:58:57.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T17:58:57.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T17:58:57.820 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-03-18T17:58:58.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T17:58:58.396 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-174-generic"... 2024-03-18T17:58:58.396 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-03-18T17:58:58.445 INFO:teuthology.orchestra.run.smithi151.stdout:5.4.0-174-generic 2024-03-18T17:58:58.445 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-174-generic vs 5.4.0-174-generic 2024-03-18T17:58:58.445 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T17:58:58.445 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-18T17:58:59.446 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-18T17:58:59.447 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-18T17:58:59.524 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-03-18T17:58:59.549 DEBUG:teuthology.parallel:result is None 2024-03-18T17:58:59.550 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-18T17:58:59.558 INFO:teuthology.task.internal:Creating test directory... 2024-03-18T17:58:59.559 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T17:58:59.561 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T17:58:59.568 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-18T17:58:59.577 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-18T17:58:59.586 INFO:teuthology.task.internal:Creating archive directory... 2024-03-18T17:58:59.587 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T17:58:59.614 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T17:58:59.640 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-18T17:58:59.647 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-18T17:58:59.648 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T17:58:59.650 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T17:58:59.668 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T17:58:59.668 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T17:58:59.678 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T17:58:59.680 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T17:58:59.682 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-18T17:58:59.690 INFO:teuthology.task.internal:Configuring sudo... 2024-03-18T17:58:59.690 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T17:58:59.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T17:58:59.743 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-18T17:58:59.754 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-18T17:58:59.755 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T17:58:59.757 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T17:58:59.793 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T17:58:59.808 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T17:58:59.818 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T17:58:59.818 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T17:58:59.839 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T17:58:59.847 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T17:58:59.897 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T17:58:59.897 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T17:58:59.919 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-03-18T17:58:59.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-03-18T17:58:59.965 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-18T17:58:59.973 INFO:teuthology.task.internal:Starting timer... 2024-03-18T17:58:59.973 INFO:teuthology.run_tasks:Running task pcp... 2024-03-18T17:58:59.984 INFO:teuthology.run_tasks:Running task selinux... 2024-03-18T17:58:59.994 DEBUG:teuthology.task.selinux:Excluding smithi094: OS 'ubuntu' does not support SELinux 2024-03-18T17:58:59.994 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-03-18T17:58:59.994 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-18T17:58:59.994 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-18T17:58:59.995 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-18T17:58:59.995 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-18T17:59:00.004 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-18T17:59:00.010 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-18T17:59:00.132 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-18T17:59:00.148 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-18T17:59:00.175 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-18T18:04:34.266 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-03-18T18:04:34.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-18T18:04:34.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T18:04:34.362 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-03-18T18:04:34.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-18T18:04:34.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T18:04:34.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T18:04:34.587 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-03-18T18:04:34.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-18T18:04:34.716 INFO:teuthology.run_tasks:Running task clock... 2024-03-18T18:04:34.727 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-18T18:04:34.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T18:04:34.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T18:04:34.730 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T18:04:34.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T18:04:34.761 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-03-18T18:04:34.761 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Command line: ntpd -gq 2024-03-18T18:04:34.762 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: proto: precision = 0.149 usec (-23) 2024-03-18T18:04:34.762 INFO:teuthology.orchestra.run.smithi094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-18T18:04:34.763 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-18T18:04:34.763 INFO:teuthology.orchestra.run.smithi094.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: restrict ::: KOD does nothing without LIMITED. 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listen and drop on 0 v6wildcard [::]:123 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listen normally on 2 lo 127.0.0.1:123 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listen normally on 3 enp3s0f1 172.21.15.94:123 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listen normally on 4 lo [::1]:123 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d763%5]:123 2024-03-18T18:04:34.765 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:34 ntpd[12938]: Listening on routing socket on fd #22 for interface updates 2024-03-18T18:04:34.767 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-03-18T18:04:34.767 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Command line: ntpd -gq 2024-03-18T18:04:34.769 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: proto: precision = 0.117 usec (-23) 2024-03-18T18:04:34.769 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-18T18:04:34.770 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-18T18:04:34.770 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: restrict ::: KOD does nothing without LIMITED. 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listen and drop on 0 v6wildcard [::]:123 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listen normally on 2 lo 127.0.0.1:123 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listen normally on 4 lo [::1]:123 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-03-18T18:04:34.771 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:34 ntpd[12944]: Listening on routing socket on fd #22 for interface updates 2024-03-18T18:04:35.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:35.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:35.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:35 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:36.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:36 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:37.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:37.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:37 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:37.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:37 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:37.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:37 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:37.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:37 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:37.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:37 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:37.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:37 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:37.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:37 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:38.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:38 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:38.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:38 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:39.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:39.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:39.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:39 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:39.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:39 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:39.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:39 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:39.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:39 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:39.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:39 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:39.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:39 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:39.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:39 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:40 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:40 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:40 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:40 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:40 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:40.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:40 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:40.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:40.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:40 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:41.762 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:41.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:41.763 INFO:teuthology.orchestra.run.smithi094.stdout:18 Mar 18:04:41 ntpd[12938]: ntpd: time slew +0.001377 s 2024-03-18T18:04:41.763 INFO:teuthology.orchestra.run.smithi094.stdout:ntpd: time slew +0.001377s 2024-03-18T18:04:41.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-18T18:04:41.763 INFO:teuthology.orchestra.run.smithi094.stderr:18 Mar 18:04:41 ntpd[12938]: can't open /var/log/ntpstats/loopstats.20240318: Permission denied 2024-03-18T18:04:41.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:41 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:41.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:41 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:41.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:41 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:41.768 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:41 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:41.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:41 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:41.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:41 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:41.838 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-03-18T18:04:41.838 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-03-18T18:04:41.838 INFO:teuthology.orchestra.run.smithi094.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:41.838 INFO:teuthology.orchestra.run.smithi094.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:41.838 INFO:teuthology.orchestra.run.smithi094.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:41.838 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: can't open /var/log/ntpstats/rawstats.20240318: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-18T18:04:42.769 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: can't open /var/log/ntpstats/peerstats.20240318: Permission denied 2024-03-18T18:04:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:18 Mar 18:04:42 ntpd[12944]: ntpd: time slew +0.003822 s 2024-03-18T18:04:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew +0.003822s 2024-03-18T18:04:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-18T18:04:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:18 Mar 18:04:42 ntpd[12944]: can't open /var/log/ntpstats/loopstats.20240318: Permission denied 2024-03-18T18:04:42.839 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-03-18T18:04:42.839 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-03-18T18:04:42.839 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:42.839 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:42.839 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:42.839 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-03-18T18:04:42.839 INFO:teuthology.run_tasks:Running task install... 2024-03-18T18:04:42.848 DEBUG:teuthology.task.install:project ceph 2024-03-18T18:04:42.848 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3'}} 2024-03-18T18:04:42.848 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3'} 2024-03-18T18:04:42.848 INFO:teuthology.task.install:Using flavor: default 2024-03-18T18:04:42.853 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-18T18:04:42.854 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-03-18T18:04:42.854 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-key list | grep Ceph 2024-03-18T18:04:42.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-03-18T18:04:42.953 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-03-18T18:04:42.985 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-03-18T18:04:43.014 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-18T18:04:43.014 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph.com (release key) 2024-03-18T18:04:43.015 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-18T18:04:43.015 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-18T18:04:43.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T18:04:43.049 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-18T18:04:43.049 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-03-18T18:04:43.050 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-18T18:04:43.050 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-18T18:04:43.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T18:04:43.154 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default/ 2024-03-18T18:04:43.154 INFO:teuthology.task.install.deb:Package version is 18.2.2-914-g49bdc511-1focal 2024-03-18T18:04:43.189 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default/ 2024-03-18T18:04:43.189 INFO:teuthology.task.install.deb:Package version is 18.2.2-914-g49bdc511-1focal 2024-03-18T18:04:43.299 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:04:43.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-18T18:04:43.316 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-03-18T18:04:43.329 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:04:43.329 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-18T18:04:43.346 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-03-18T18:04:43.511 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-03-18T18:04:43.520 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-03-18T18:04:43.541 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-03-18T18:04:43.542 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal InRelease 2024-03-18T18:04:43.564 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-03-18T18:04:43.588 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal Release.gpg 2024-03-18T18:04:43.615 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2024-03-18T18:04:43.615 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main i386 Packages [3,409 B] 2024-03-18T18:04:43.617 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal InRelease 2024-03-18T18:04:43.627 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-03-18T18:04:43.627 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-03-18T18:04:43.646 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-03-18T18:04:43.653 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-03-18T18:04:43.684 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-03-18T18:04:43.691 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal Release.gpg 2024-03-18T18:04:43.728 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-03-18T18:04:43.766 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-03-18T18:04:43.773 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main i386 Packages [3,409 B] 2024-03-18T18:04:44.164 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 28.4 kB in 1s (44.7 kB/s) 2024-03-18T18:04:44.261 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 28.4 kB in 1s (37.7 kB/s) 2024-03-18T18:04:45.266 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T18:04:45.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-914-g49bdc511-1focal cephadm=18.2.2-914-g49bdc511-1focal ceph-mds=18.2.2-914-g49bdc511-1focal ceph-mgr=18.2.2-914-g49bdc511-1focal ceph-common=18.2.2-914-g49bdc511-1focal ceph-fuse=18.2.2-914-g49bdc511-1focal ceph-test=18.2.2-914-g49bdc511-1focal ceph-volume=18.2.2-914-g49bdc511-1focal radosgw=18.2.2-914-g49bdc511-1focal python3-rados=18.2.2-914-g49bdc511-1focal python3-rgw=18.2.2-914-g49bdc511-1focal python3-cephfs=18.2.2-914-g49bdc511-1focal python3-rbd=18.2.2-914-g49bdc511-1focal libcephfs2=18.2.2-914-g49bdc511-1focal libcephfs-dev=18.2.2-914-g49bdc511-1focal librados2=18.2.2-914-g49bdc511-1focal librbd1=18.2.2-914-g49bdc511-1focal rbd-fuse=18.2.2-914-g49bdc511-1focal python3-cephfs=18.2.2-914-g49bdc511-1focal cephfs-shell=18.2.2-914-g49bdc511-1focal cephfs-top=18.2.2-914-g49bdc511-1focal cephfs-mirror=18.2.2-914-g49bdc511-1focal 2024-03-18T18:04:45.353 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T18:04:45.360 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T18:04:45.377 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-914-g49bdc511-1focal cephadm=18.2.2-914-g49bdc511-1focal ceph-mds=18.2.2-914-g49bdc511-1focal ceph-mgr=18.2.2-914-g49bdc511-1focal ceph-common=18.2.2-914-g49bdc511-1focal ceph-fuse=18.2.2-914-g49bdc511-1focal ceph-test=18.2.2-914-g49bdc511-1focal ceph-volume=18.2.2-914-g49bdc511-1focal radosgw=18.2.2-914-g49bdc511-1focal python3-rados=18.2.2-914-g49bdc511-1focal python3-rgw=18.2.2-914-g49bdc511-1focal python3-cephfs=18.2.2-914-g49bdc511-1focal python3-rbd=18.2.2-914-g49bdc511-1focal libcephfs2=18.2.2-914-g49bdc511-1focal libcephfs-dev=18.2.2-914-g49bdc511-1focal librados2=18.2.2-914-g49bdc511-1focal librbd1=18.2.2-914-g49bdc511-1focal rbd-fuse=18.2.2-914-g49bdc511-1focal python3-cephfs=18.2.2-914-g49bdc511-1focal cephfs-shell=18.2.2-914-g49bdc511-1focal cephfs-top=18.2.2-914-g49bdc511-1focal cephfs-mirror=18.2.2-914-g49bdc511-1focal 2024-03-18T18:04:45.450 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T18:04:45.546 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-03-18T18:04:45.546 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-03-18T18:04:45.658 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-03-18T18:04:45.659 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-03-18T18:04:45.728 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-03-18T18:04:45.730 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-03-18T18:04:45.731 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: qttranslations5-l10n socat xmlstarlet 2024-03-18T18:04:45.732 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-03-18T18:04:45.733 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-03-18T18:04:45.844 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-03-18T18:04:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-03-18T18:04:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-03-18T18:04:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-03-18T18:04:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-03-18T18:04:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-03-18T18:04:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-03-18T18:04:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-03-18T18:04:45.848 INFO:teuthology.orchestra.run.smithi094.stdout: qttranslations5-l10n socat xmlstarlet 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-03-18T18:04:45.849 INFO:teuthology.orchestra.run.smithi094.stdout: btrfs-tools 2024-03-18T18:04:45.856 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-03-18T18:04:45.856 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-18T18:04:45.856 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-18T18:04:45.857 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-18T18:04:45.857 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-03-18T18:04:45.857 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-03-18T18:04:45.857 INFO:teuthology.orchestra.run.smithi151.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-03-18T18:04:45.857 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-03-18T18:04:45.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-03-18T18:04:45.859 INFO:teuthology.orchestra.run.smithi151.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-03-18T18:04:45.860 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-03-18T18:04:45.860 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 librbd1 2024-03-18T18:04:45.929 INFO:teuthology.orchestra.run.smithi151.stdout:2 upgraded, 116 newly installed, 0 to remove and 274 not upgraded. 2024-03-18T18:04:45.929 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 208 MB of archives. 2024-03-18T18:04:45.929 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 1,031 MB of additional disk space will be used. 2024-03-18T18:04:45.929 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-03-18T18:04:45.951 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-03-18T18:04:45.961 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-03-18T18:04:45.975 INFO:teuthology.orchestra.run.smithi094.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-03-18T18:04:45.976 INFO:teuthology.orchestra.run.smithi094.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-03-18T18:04:45.977 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-03-18T18:04:45.978 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 librbd1 2024-03-18T18:04:45.991 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-03-18T18:04:46.027 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-03-18T18:04:46.031 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-03-18T18:04:46.047 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-03-18T18:04:46.090 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-914-g49bdc511-1focal [3,443 kB] 2024-03-18T18:04:46.119 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-03-18T18:04:46.123 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-03-18T18:04:46.128 INFO:teuthology.orchestra.run.smithi094.stdout:2 upgraded, 116 newly installed, 0 to remove and 274 not upgraded. 2024-03-18T18:04:46.128 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 208 MB of archives. 2024-03-18T18:04:46.128 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 1,031 MB of additional disk space will be used. 2024-03-18T18:04:46.128 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-914-g49bdc511-1focal [3,443 kB] 2024-03-18T18:04:46.138 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-03-18T18:04:46.144 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-03-18T18:04:46.146 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-03-18T18:04:46.148 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-03-18T18:04:46.148 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-03-18T18:04:46.159 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-03-18T18:04:46.159 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-03-18T18:04:46.164 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-03-18T18:04:46.169 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-03-18T18:04:46.184 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-03-18T18:04:46.185 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-03-18T18:04:46.186 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-03-18T18:04:46.187 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-18T18:04:46.188 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-03-18T18:04:46.189 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-03-18T18:04:46.190 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-03-18T18:04:46.191 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-03-18T18:04:46.193 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-03-18T18:04:46.211 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-03-18T18:04:46.212 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-03-18T18:04:46.218 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-03-18T18:04:46.218 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-03-18T18:04:46.218 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-03-18T18:04:46.219 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-03-18T18:04:46.232 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-03-18T18:04:46.236 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-03-18T18:04:46.240 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-03-18T18:04:46.240 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-03-18T18:04:46.252 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-03-18T18:04:46.253 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-03-18T18:04:46.254 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-03-18T18:04:46.255 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-03-18T18:04:46.255 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-03-18T18:04:46.256 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-03-18T18:04:46.257 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-03-18T18:04:46.273 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-03-18T18:04:46.273 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-03-18T18:04:46.274 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-03-18T18:04:46.276 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-18T18:04:46.290 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-03-18T18:04:46.294 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-03-18T18:04:46.296 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-03-18T18:04:46.298 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-03-18T18:04:46.299 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-03-18T18:04:46.300 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-03-18T18:04:46.301 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-03-18T18:04:46.404 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-914-g49bdc511-1focal [4,004 kB] 2024-03-18T18:04:46.426 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-03-18T18:04:46.427 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-03-18T18:04:46.452 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-03-18T18:04:46.454 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-03-18T18:04:46.474 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-03-18T18:04:46.474 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-03-18T18:04:46.475 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-03-18T18:04:46.475 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-03-18T18:04:46.475 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-03-18T18:04:46.476 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-03-18T18:04:46.476 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-03-18T18:04:46.481 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-03-18T18:04:46.481 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-03-18T18:04:46.501 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-03-18T18:04:46.504 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-03-18T18:04:46.506 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-03-18T18:04:46.507 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-03-18T18:04:46.508 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-03-18T18:04:46.511 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-03-18T18:04:46.514 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-03-18T18:04:46.514 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-03-18T18:04:46.537 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-03-18T18:04:46.540 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-03-18T18:04:46.551 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-914-g49bdc511-1focal [739 kB] 2024-03-18T18:04:46.554 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-03-18T18:04:46.559 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-03-18T18:04:46.572 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-914-g49bdc511-1focal [386 kB] 2024-03-18T18:04:46.577 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-03-18T18:04:46.584 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-914-g49bdc511-1focal [31.9 kB] 2024-03-18T18:04:46.585 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-914-g49bdc511-1focal [200 kB] 2024-03-18T18:04:46.591 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-914-g49bdc511-1focal [61.3 kB] 2024-03-18T18:04:46.593 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-914-g49bdc511-1focal [364 kB] 2024-03-18T18:04:46.606 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-914-g49bdc511-1focal [6,594 kB] 2024-03-18T18:04:46.613 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-03-18T18:04:46.613 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-03-18T18:04:46.614 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-03-18T18:04:46.614 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-03-18T18:04:46.630 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-18T18:04:46.630 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-03-18T18:04:46.632 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-03-18T18:04:46.632 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-03-18T18:04:46.633 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-03-18T18:04:46.638 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-03-18T18:04:46.837 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-03-18T18:04:46.838 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-914-g49bdc511-1focal [113 kB] 2024-03-18T18:04:46.841 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-914-g49bdc511-1focal [475 kB] 2024-03-18T18:04:46.846 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-03-18T18:04:46.859 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-914-g49bdc511-1focal [25.2 MB] 2024-03-18T18:04:46.872 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-03-18T18:04:46.880 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-03-18T18:04:47.044 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-03-18T18:04:47.411 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-03-18T18:04:47.430 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-03-18T18:04:47.606 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-03-18T18:04:47.615 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-03-18T18:04:47.648 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-03-18T18:04:47.654 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-03-18T18:04:47.658 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-03-18T18:04:47.660 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-03-18T18:04:47.669 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-18T18:04:47.671 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-03-18T18:04:47.835 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-03-18T18:04:47.904 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-914-g49bdc511-1focal [11.0 MB] 2024-03-18T18:04:47.904 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-914-g49bdc511-1focal [4,004 kB] 2024-03-18T18:04:48.154 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-03-18T18:04:48.233 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-914-g49bdc511-1focal [237 kB] 2024-03-18T18:04:48.233 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-03-18T18:04:48.237 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-914-g49bdc511-1focal [148 kB] 2024-03-18T18:04:48.239 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-914-g49bdc511-1focal [1,566 kB] 2024-03-18T18:04:48.248 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-03-18T18:04:48.255 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-914-g49bdc511-1focal [9,421 kB] 2024-03-18T18:04:48.324 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-03-18T18:04:48.328 INFO:teuthology.orchestra.run.smithi094.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-03-18T18:04:48.453 INFO:teuthology.orchestra.run.smithi094.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-03-18T18:04:48.454 INFO:teuthology.orchestra.run.smithi094.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-03-18T18:04:48.457 INFO:teuthology.orchestra.run.smithi094.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-03-18T18:04:48.461 INFO:teuthology.orchestra.run.smithi094.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-03-18T18:04:48.473 INFO:teuthology.orchestra.run.smithi094.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-03-18T18:04:48.602 INFO:teuthology.orchestra.run.smithi094.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-914-g49bdc511-1focal [31.3 MB] 2024-03-18T18:04:48.660 INFO:teuthology.orchestra.run.smithi094.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-03-18T18:04:48.869 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-914-g49bdc511-1focal [739 kB] 2024-03-18T18:04:49.021 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-914-g49bdc511-1focal [386 kB] 2024-03-18T18:04:49.094 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-914-g49bdc511-1focal [31.9 kB] 2024-03-18T18:04:49.098 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-914-g49bdc511-1focal [200 kB] 2024-03-18T18:04:49.102 INFO:teuthology.orchestra.run.smithi094.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-03-18T18:04:49.114 INFO:teuthology.orchestra.run.smithi094.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-03-18T18:04:49.141 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-914-g49bdc511-1focal [61.3 kB] 2024-03-18T18:04:49.152 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-914-g49bdc511-1focal [364 kB] 2024-03-18T18:04:49.159 INFO:teuthology.orchestra.run.smithi094.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-03-18T18:04:49.203 INFO:teuthology.orchestra.run.smithi094.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-03-18T18:04:49.212 INFO:teuthology.orchestra.run.smithi094.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-03-18T18:04:49.215 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-914-g49bdc511-1focal [6,594 kB] 2024-03-18T18:04:49.217 INFO:teuthology.orchestra.run.smithi094.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-03-18T18:04:49.227 INFO:teuthology.orchestra.run.smithi094.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-03-18T18:04:49.232 INFO:teuthology.orchestra.run.smithi094.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-03-18T18:04:49.248 INFO:teuthology.orchestra.run.smithi094.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-03-18T18:04:49.250 INFO:teuthology.orchestra.run.smithi094.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-03-18T18:04:49.420 INFO:teuthology.orchestra.run.smithi094.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-03-18T18:04:49.832 INFO:teuthology.orchestra.run.smithi094.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-18T18:04:49.835 INFO:teuthology.orchestra.run.smithi094.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-03-18T18:04:49.928 INFO:teuthology.orchestra.run.smithi094.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-03-18T18:04:49.989 INFO:teuthology.orchestra.run.smithi094.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-03-18T18:04:49.991 INFO:teuthology.orchestra.run.smithi094.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-914-g49bdc511-1focal [13.7 kB] 2024-03-18T18:04:49.992 INFO:teuthology.orchestra.run.smithi094.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-03-18T18:04:49.992 INFO:teuthology.orchestra.run.smithi094.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-914-g49bdc511-1focal [847 kB] 2024-03-18T18:04:49.993 INFO:teuthology.orchestra.run.smithi094.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-03-18T18:04:49.995 INFO:teuthology.orchestra.run.smithi094.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-03-18T18:04:50.006 INFO:teuthology.orchestra.run.smithi094.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-914-g49bdc511-1focal [2,312 kB] 2024-03-18T18:04:50.023 INFO:teuthology.orchestra.run.smithi094.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-914-g49bdc511-1focal [236 kB] 2024-03-18T18:04:50.025 INFO:teuthology.orchestra.run.smithi094.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-914-g49bdc511-1focal [142 kB] 2024-03-18T18:04:50.027 INFO:teuthology.orchestra.run.smithi094.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-914-g49bdc511-1focal [1,817 kB] 2024-03-18T18:04:50.085 INFO:teuthology.orchestra.run.smithi094.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-914-g49bdc511-1focal [7,894 kB] 2024-03-18T18:04:50.249 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-914-g49bdc511-1focal [113 kB] 2024-03-18T18:04:50.261 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-914-g49bdc511-1focal [475 kB] 2024-03-18T18:04:50.338 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-914-g49bdc511-1focal [25.2 MB] 2024-03-18T18:04:50.413 INFO:teuthology.orchestra.run.smithi094.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-914-g49bdc511-1focal [13.9 kB] 2024-03-18T18:04:50.413 INFO:teuthology.orchestra.run.smithi094.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-914-g49bdc511-1focal [50.2 MB] 2024-03-18T18:04:50.453 INFO:teuthology.orchestra.run.smithi094.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-03-18T18:04:50.530 INFO:teuthology.orchestra.run.smithi094.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-03-18T18:04:50.532 INFO:teuthology.orchestra.run.smithi094.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-03-18T18:04:50.745 INFO:teuthology.orchestra.run.smithi094.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-03-18T18:04:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-03-18T18:04:50.950 INFO:teuthology.orchestra.run.smithi094.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-03-18T18:04:51.006 INFO:teuthology.orchestra.run.smithi094.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-03-18T18:04:51.032 INFO:teuthology.orchestra.run.smithi094.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-03-18T18:04:51.067 INFO:teuthology.orchestra.run.smithi094.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-03-18T18:04:51.080 INFO:teuthology.orchestra.run.smithi094.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-03-18T18:04:51.131 INFO:teuthology.orchestra.run.smithi094.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-03-18T18:04:51.138 INFO:teuthology.orchestra.run.smithi094.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-03-18T18:04:51.152 INFO:teuthology.orchestra.run.smithi094.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-03-18T18:04:51.231 INFO:teuthology.orchestra.run.smithi094.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-03-18T18:04:51.420 INFO:teuthology.orchestra.run.smithi094.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-03-18T18:04:51.784 INFO:teuthology.orchestra.run.smithi094.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-03-18T18:04:51.809 INFO:teuthology.orchestra.run.smithi094.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-03-18T18:04:51.959 INFO:teuthology.orchestra.run.smithi094.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-03-18T18:04:52.015 INFO:teuthology.orchestra.run.smithi094.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-03-18T18:04:52.019 INFO:teuthology.orchestra.run.smithi094.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-03-18T18:04:52.189 INFO:teuthology.orchestra.run.smithi094.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-03-18T18:04:52.195 INFO:teuthology.orchestra.run.smithi094.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-03-18T18:04:52.205 INFO:teuthology.orchestra.run.smithi094.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-03-18T18:04:52.362 INFO:teuthology.orchestra.run.smithi094.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-03-18T18:04:52.363 INFO:teuthology.orchestra.run.smithi094.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-03-18T18:04:52.527 INFO:teuthology.orchestra.run.smithi094.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-03-18T18:04:52.777 INFO:teuthology.orchestra.run.smithi094.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-914-g49bdc511-1focal [119 kB] 2024-03-18T18:04:52.779 INFO:teuthology.orchestra.run.smithi094.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.2-914-g49bdc511-1focal [268 kB] 2024-03-18T18:04:52.784 INFO:teuthology.orchestra.run.smithi094.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.2-914-g49bdc511-1focal [33.0 kB] 2024-03-18T18:04:52.785 INFO:teuthology.orchestra.run.smithi094.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.2-914-g49bdc511-1focal [22.8 kB] 2024-03-18T18:04:52.786 INFO:teuthology.orchestra.run.smithi094.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-914-g49bdc511-1focal [37.4 kB] 2024-03-18T18:04:52.787 INFO:teuthology.orchestra.run.smithi094.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-914-g49bdc511-1focal [13.4 MB] 2024-03-18T18:04:52.859 INFO:teuthology.orchestra.run.smithi094.stdout:Get:112 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-03-18T18:04:53.213 INFO:teuthology.orchestra.run.smithi094.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-914-g49bdc511-1focal [107 kB] 2024-03-18T18:04:53.296 INFO:teuthology.orchestra.run.smithi094.stdout:Get:114 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-18T18:04:53.297 INFO:teuthology.orchestra.run.smithi094.stdout:Get:115 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-03-18T18:04:53.300 INFO:teuthology.orchestra.run.smithi094.stdout:Get:116 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-03-18T18:04:53.301 INFO:teuthology.orchestra.run.smithi094.stdout:Get:117 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-03-18T18:04:53.302 INFO:teuthology.orchestra.run.smithi094.stdout:Get:118 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-03-18T18:04:53.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-914-g49bdc511-1focal [11.0 MB] 2024-03-18T18:04:53.962 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 208 MB in 7s (28.4 MB/s) 2024-03-18T18:04:54.101 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-18T18:04:54.155 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-03-18T18:04:54.159 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-03-18T18:04:54.224 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-03-18T18:04:54.535 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-18T18:04:54.551 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-03-18T18:04:54.593 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-03-18T18:04:54.629 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-914-g49bdc511-1focal [237 kB] 2024-03-18T18:04:54.630 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-914-g49bdc511-1focal [148 kB] 2024-03-18T18:04:54.632 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-914-g49bdc511-1focal [1,566 kB] 2024-03-18T18:04:54.871 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cmd2. 2024-03-18T18:04:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-914-g49bdc511-1focal [9,421 kB] 2024-03-18T18:04:54.890 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-03-18T18:04:54.930 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-03-18T18:04:55.266 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-03-18T18:04:55.282 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-03-18T18:04:55.366 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-03-18T18:04:55.729 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-18T18:04:55.745 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-03-18T18:04:55.787 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-03-18T18:04:56.123 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-18T18:04:56.139 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-03-18T18:04:56.173 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-03-18T18:04:56.627 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-18T18:04:56.645 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-03-18T18:04:56.696 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:04:57.206 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-18T18:04:57.222 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-03-18T18:04:57.264 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:04:57.609 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-18T18:04:57.626 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-03-18T18:04:57.658 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:04:58.037 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-03-18T18:04:58.053 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-03-18T18:04:58.095 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-03-18T18:04:58.295 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-914-g49bdc511-1focal [31.3 MB] 2024-03-18T18:04:58.489 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../010-librbd1_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:04:58.615 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1 (18.2.2-914-g49bdc511-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-03-18T18:04:59.272 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../011-librados2_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:04:59.420 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2 (18.2.2-914-g49bdc511-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-03-18T18:05:00.149 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2. 2024-03-18T18:05:00.166 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../012-libcephfs2_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:00.224 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:00.510 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rados. 2024-03-18T18:05:00.529 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../013-python3-rados_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:00.560 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rados (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:00.913 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-18T18:05:00.932 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:00.971 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-argparse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:01.249 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cephfs. 2024-03-18T18:05:01.264 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../015-python3-cephfs_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:01.307 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cephfs (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:01.626 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-18T18:05:01.645 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:01.685 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:02.022 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-prettytable. 2024-03-18T18:05:02.038 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-03-18T18:05:02.080 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-03-18T18:05:02.333 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rbd. 2024-03-18T18:05:02.348 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../018-python3-rbd_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:02.438 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rbd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:02.936 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-03-18T18:05:02.951 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-03-18T18:05:02.994 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-03-18T18:05:03.272 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-03-18T18:05:03.288 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-03-18T18:05:03.322 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-03-18T18:05:03.675 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-18T18:05:03.693 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-03-18T18:05:03.733 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-03-18T18:05:04.087 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2. 2024-03-18T18:05:04.102 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../022-librgw2_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:04.145 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:04.588 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-914-g49bdc511-1focal [13.7 kB] 2024-03-18T18:05:04.589 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-914-g49bdc511-1focal [847 kB] 2024-03-18T18:05:04.625 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-914-g49bdc511-1focal [2,312 kB] 2024-03-18T18:05:04.994 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-914-g49bdc511-1focal [236 kB] 2024-03-18T18:05:05.014 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rgw. 2024-03-18T18:05:05.033 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../023-python3-rgw_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:05.045 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-914-g49bdc511-1focal [142 kB] 2024-03-18T18:05:05.056 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-914-g49bdc511-1focal [1,817 kB] 2024-03-18T18:05:05.064 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:05.433 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liboath0. 2024-03-18T18:05:05.449 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-03-18T18:05:05.492 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-03-18T18:05:05.542 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-914-g49bdc511-1focal [7,894 kB] 2024-03-18T18:05:05.820 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1. 2024-03-18T18:05:05.836 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../025-libradosstriper1_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:05.878 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:06.348 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common. 2024-03-18T18:05:06.364 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../026-ceph-common_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:06.398 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-914-g49bdc511-1focal [13.9 kB] 2024-03-18T18:05:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-914-g49bdc511-1focal [50.2 MB] 2024-03-18T18:05:08.938 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-base. 2024-03-18T18:05:08.954 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../027-ceph-base_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:09.006 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-base (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:10.410 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-18T18:05:10.426 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-03-18T18:05:10.492 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-03-18T18:05:10.829 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-natsort. 2024-03-18T18:05:10.846 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-03-18T18:05:10.887 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-03-18T18:05:11.224 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-logutils. 2024-03-18T18:05:11.239 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-03-18T18:05:11.307 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-03-18T18:05:11.585 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-18T18:05:11.602 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-03-18T18:05:11.652 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-03-18T18:05:11.905 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-mako. 2024-03-18T18:05:11.924 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-03-18T18:05:11.963 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-03-18T18:05:12.316 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-18T18:05:12.336 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-18T18:05:12.375 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-18T18:05:12.669 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-18T18:05:12.688 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-03-18T18:05:12.728 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-03-18T18:05:13.039 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webob. 2024-03-18T18:05:13.055 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-03-18T18:05:13.097 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-03-18T18:05:13.409 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-soupsieve. 2024-03-18T18:05:13.428 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-03-18T18:05:13.467 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-03-18T18:05:13.728 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bs4. 2024-03-18T18:05:13.748 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-03-18T18:05:13.786 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-03-18T18:05:14.115 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-waitress. 2024-03-18T18:05:14.132 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-03-18T18:05:14.168 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-03-18T18:05:14.435 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempita. 2024-03-18T18:05:14.453 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-03-18T18:05:14.485 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-03-18T18:05:14.821 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-paste. 2024-03-18T18:05:14.838 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-03-18T18:05:14.879 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-03-18T18:05:15.182 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-18T18:05:15.199 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-03-18T18:05:15.240 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-03-18T18:05:15.544 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-18T18:05:15.562 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-03-18T18:05:15.610 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-03-18T18:05:15.897 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webtest. 2024-03-18T18:05:15.916 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-03-18T18:05:15.955 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-03-18T18:05:16.266 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pecan. 2024-03-18T18:05:16.282 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-03-18T18:05:16.325 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-03-18T18:05:16.688 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-18T18:05:16.704 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-03-18T18:05:16.746 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-03-18T18:05:17.008 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-18T18:05:17.026 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:17.058 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-modules-core (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:17.471 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-18T18:05:17.487 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:17.530 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:17.833 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cryptography. 2024-03-18T18:05:17.852 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-03-18T18:05:17.891 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-03-18T18:05:19.162 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-openssl. 2024-03-18T18:05:19.181 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2024-03-18T18:05:19.220 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-03-18T18:05:19.581 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr. 2024-03-18T18:05:19.598 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../050-ceph-mgr_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:19.639 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:20.126 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon. 2024-03-18T18:05:20.143 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../051-ceph-mon_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:20.184 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:21.480 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd. 2024-03-18T18:05:21.495 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../052-ceph-osd_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:21.538 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:22.539 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-914-g49bdc511-1focal [119 kB] 2024-03-18T18:05:22.541 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.2-914-g49bdc511-1focal [268 kB] 2024-03-18T18:05:22.610 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.2-914-g49bdc511-1focal [33.0 kB] 2024-03-18T18:05:22.618 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.2-914-g49bdc511-1focal [22.8 kB] 2024-03-18T18:05:22.682 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-914-g49bdc511-1focal [37.4 kB] 2024-03-18T18:05:22.684 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-914-g49bdc511-1focal [13.4 MB] 2024-03-18T18:05:24.650 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph. 2024-03-18T18:05:24.666 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../053-ceph_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:24.708 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:25.060 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse. 2024-03-18T18:05:25.078 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../054-ceph-fuse_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:25.118 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:25.539 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds. 2024-03-18T18:05:25.555 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../055-ceph-mds_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:25.597 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:26.167 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephadm. 2024-03-18T18:05:26.185 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../056-cephadm_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:26.216 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:26.536 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-18T18:05:26.552 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2024-03-18T18:05:26.603 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-03-18T18:05:26.973 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jinja2. 2024-03-18T18:05:26.992 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-03-18T18:05:27.031 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-03-18T18:05:27.309 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-18T18:05:27.328 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:27.367 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:27.401 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-yuri10-testing-2024-03-15-1653-reef/49bdc51142759622a281d3e5327eebd07cbb8bb3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-914-g49bdc511-1focal [107 kB] 2024-03-18T18:05:27.729 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-18T18:05:27.749 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-03-18T18:05:27.787 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-03-18T18:05:28.039 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 208 MB in 42s (5,014 kB/s) 2024-03-18T18:05:28.073 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jwt. 2024-03-18T18:05:28.093 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-03-18T18:05:28.131 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-03-18T18:05:28.164 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-18T18:05:28.220 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-03-18T18:05:28.225 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-03-18T18:05:28.263 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-03-18T18:05:28.476 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-attr. 2024-03-18T18:05:28.492 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-03-18T18:05:28.534 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-03-18T18:05:28.574 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-18T18:05:28.591 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-03-18T18:05:28.632 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-03-18T18:05:28.888 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pluggy. 2024-03-18T18:05:28.903 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-03-18T18:05:28.936 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cmd2. 2024-03-18T18:05:28.945 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-03-18T18:05:28.956 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-03-18T18:05:29.019 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-03-18T18:05:29.341 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-py. 2024-03-18T18:05:29.356 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-03-18T18:05:29.358 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-03-18T18:05:29.372 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-03-18T18:05:29.390 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-03-18T18:05:29.465 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-03-18T18:05:29.677 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-atomicwrites. 2024-03-18T18:05:29.696 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-03-18T18:05:29.735 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-03-18T18:05:29.845 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-18T18:05:29.860 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-03-18T18:05:29.903 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-03-18T18:05:30.038 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-packaging. 2024-03-18T18:05:30.054 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-03-18T18:05:30.112 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-packaging (20.3-1) ... 2024-03-18T18:05:30.265 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-18T18:05:30.282 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-03-18T18:05:30.323 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-03-18T18:05:30.424 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pytest. 2024-03-18T18:05:30.440 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-03-18T18:05:30.482 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-03-18T18:05:30.769 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-18T18:05:30.789 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-03-18T18:05:30.827 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-18T18:05:30.843 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-03-18T18:05:30.870 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:05:30.877 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-18T18:05:31.163 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-underscore. 2024-03-18T18:05:31.179 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-03-18T18:05:31.221 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-03-18T18:05:31.340 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-18T18:05:31.356 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-03-18T18:05:31.399 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:05:31.507 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-03-18T18:05:31.522 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-03-18T18:05:31.565 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-03-18T18:05:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-18T18:05:31.795 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-03-18T18:05:31.836 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:05:31.909 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-routes. 2024-03-18T18:05:31.926 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-03-18T18:05:31.967 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-03-18T18:05:32.240 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-03-18T18:05:32.255 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-03-18T18:05:32.295 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-18T18:05:32.298 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-03-18T18:05:32.311 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:32.353 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dashboard (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:32.692 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-librbd1_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:32.827 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (18.2.2-914-g49bdc511-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-03-18T18:05:32.907 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-decorator. 2024-03-18T18:05:32.923 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-03-18T18:05:32.965 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-03-18T18:05:33.268 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-03-18T18:05:33.283 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-03-18T18:05:33.326 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-03-18T18:05:33.523 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-librados2_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:33.649 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (18.2.2-914-g49bdc511-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-03-18T18:05:33.682 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-scipy. 2024-03-18T18:05:33.699 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-03-18T18:05:33.740 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-03-18T18:05:34.371 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-03-18T18:05:34.388 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-libcephfs2_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:34.429 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:34.958 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-03-18T18:05:34.974 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-rados_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:35.016 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:35.414 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-03-18T18:05:35.433 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-03-18T18:05:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-18T18:05:35.469 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:35.472 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-03-18T18:05:35.511 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:35.789 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-03-18T18:05:35.806 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-cephfs_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:35.847 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:36.009 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-joblib. 2024-03-18T18:05:36.026 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-03-18T18:05:36.100 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-03-18T18:05:36.176 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-18T18:05:36.194 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:36.234 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:36.454 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn. 2024-03-18T18:05:36.470 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-03-18T18:05:36.512 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-03-18T18:05:36.588 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-03-18T18:05:36.606 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-03-18T18:05:36.646 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-03-18T18:05:36.932 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-03-18T18:05:36.953 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-python3-rbd_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:36.991 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:37.204 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-18T18:05:37.222 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:37.262 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:37.344 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-03-18T18:05:37.363 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-03-18T18:05:37.403 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-03-18T18:05:37.781 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-03-18T18:05:37.797 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-03-18T18:05:37.839 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-03-18T18:05:38.201 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-18T18:05:38.219 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-03-18T18:05:38.260 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-03-18T18:05:38.373 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cachetools. 2024-03-18T18:05:38.393 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-03-18T18:05:38.431 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-03-18T18:05:38.613 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-03-18T18:05:38.631 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-librgw2_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:38.672 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:38.861 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-18T18:05:38.878 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-03-18T18:05:38.919 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-03-18T18:05:39.248 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-18T18:05:39.267 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-03-18T18:05:39.306 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-03-18T18:05:39.591 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-03-18T18:05:39.609 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-python3-rgw_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:39.649 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:39.651 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rsa. 2024-03-18T18:05:39.667 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-03-18T18:05:39.710 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rsa (4.0-3) ... 2024-03-18T18:05:40.021 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-google-auth. 2024-03-18T18:05:40.037 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0. 2024-03-18T18:05:40.037 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-03-18T18:05:40.052 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-03-18T18:05:40.079 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-03-18T18:05:40.095 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-03-18T18:05:40.399 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-blinker. 2024-03-18T18:05:40.415 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-03-18T18:05:40.415 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-03-18T18:05:40.431 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-libradosstriper1_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:40.457 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-03-18T18:05:40.473 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:40.776 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-oauthlib. 2024-03-18T18:05:40.794 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-03-18T18:05:40.835 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-03-18T18:05:40.952 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-03-18T18:05:40.970 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-ceph-common_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:41.010 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:41.198 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-18T18:05:41.214 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-03-18T18:05:41.256 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-03-18T18:05:41.542 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-websocket. 2024-03-18T18:05:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-03-18T18:05:41.600 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-03-18T18:05:41.920 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-18T18:05:41.940 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-03-18T18:05:42.003 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-03-18T18:05:42.558 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-18T18:05:42.575 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:42.616 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:42.977 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-18T18:05:42.995 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-03-18T18:05:43.035 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-03-18T18:05:43.388 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-18T18:05:43.404 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:05:43.446 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:05:43.492 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-03-18T18:05:43.508 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-ceph-base_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:43.561 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:43.732 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package jq. 2024-03-18T18:05:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:05:43.790 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:05:44.035 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package socat. 2024-03-18T18:05:44.053 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-03-18T18:05:44.093 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking socat (1.7.3.3-2) ... 2024-03-18T18:05:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package xmlstarlet. 2024-03-18T18:05:44.421 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-03-18T18:05:44.463 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-03-18T18:05:44.809 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test. 2024-03-18T18:05:44.826 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../096-ceph-test_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:44.866 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:44.956 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-18T18:05:44.975 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-03-18T18:05:45.006 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-03-18T18:05:45.319 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-03-18T18:05:45.335 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-03-18T18:05:45.368 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-03-18T18:05:45.731 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-03-18T18:05:45.747 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-03-18T18:05:45.789 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-03-18T18:05:46.118 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-18T18:05:46.134 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-03-18T18:05:46.176 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-03-18T18:05:46.454 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-03-18T18:05:46.473 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-03-18T18:05:46.504 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-03-18T18:05:46.850 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-18T18:05:46.869 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-18T18:05:46.908 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-18T18:05:47.220 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-18T18:05:47.236 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-03-18T18:05:47.303 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-03-18T18:05:47.540 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-03-18T18:05:47.556 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-03-18T18:05:47.598 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-03-18T18:05:47.935 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-soupsieve. 2024-03-18T18:05:47.951 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-03-18T18:05:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-03-18T18:05:48.305 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bs4. 2024-03-18T18:05:48.322 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-03-18T18:05:48.363 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-03-18T18:05:48.734 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-03-18T18:05:48.751 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-03-18T18:05:48.795 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-03-18T18:05:49.130 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-03-18T18:05:49.146 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-03-18T18:05:49.179 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-03-18T18:05:49.279 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-volume. 2024-03-18T18:05:49.295 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:49.337 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-volume (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:49.483 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-03-18T18:05:49.499 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-03-18T18:05:49.541 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-03-18T18:05:49.716 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-18T18:05:49.734 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:49.782 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-mirror (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:49.895 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-18T18:05:49.911 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-03-18T18:05:49.954 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-03-18T18:05:50.127 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-colorama. 2024-03-18T18:05:50.144 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-03-18T18:05:50.185 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-03-18T18:05:50.257 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-18T18:05:50.274 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-03-18T18:05:50.340 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-03-18T18:05:50.447 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-shell. 2024-03-18T18:05:50.463 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../100-cephfs-shell_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:50.505 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-shell (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:50.652 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-03-18T18:05:50.668 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-03-18T18:05:50.710 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-03-18T18:05:50.799 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-top. 2024-03-18T18:05:50.816 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../101-cephfs-top_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:50.857 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-top (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:51.039 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-03-18T18:05:51.057 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-03-18T18:05:51.093 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package fonts-mathjax. 2024-03-18T18:05:51.097 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-03-18T18:05:51.113 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-03-18T18:05:51.143 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:05:51.445 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-18T18:05:51.460 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-03-18T18:05:51.503 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-03-18T18:05:51.731 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-18T18:05:51.747 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:51.788 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs-dev (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:51.815 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-18T18:05:51.832 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:05:51.873 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:52.167 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package nvme-cli. 2024-03-18T18:05:52.183 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-03-18T18:05:52.242 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-03-18T18:05:52.254 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-18T18:05:52.273 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:52.313 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:52.571 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-18T18:05:52.590 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-03-18T18:05:52.629 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-03-18T18:05:52.641 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cryptography. 2024-03-18T18:05:52.661 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-03-18T18:05:52.699 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-03-18T18:05:53.011 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-mathjax. 2024-03-18T18:05:53.027 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-03-18T18:05:53.068 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:05:53.089 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-03-18T18:05:53.105 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2024-03-18T18:05:53.147 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-03-18T18:05:53.517 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-03-18T18:05:53.533 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-ceph-mgr_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:53.575 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:54.045 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-03-18T18:05:54.064 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-ceph-mon_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:54.094 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:54.840 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-natsort-doc. 2024-03-18T18:05:54.862 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-03-18T18:05:54.898 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-03-18T18:05:55.276 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webencodings. 2024-03-18T18:05:55.293 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-03-18T18:05:55.326 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-03-18T18:05:55.482 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-03-18T18:05:55.498 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-ceph-osd_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:55.539 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:55.632 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-html5lib. 2024-03-18T18:05:55.650 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-03-18T18:05:55.690 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-03-18T18:05:56.069 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-03-18T18:05:56.087 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-03-18T18:05:56.127 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-03-18T18:05:56.589 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastescript. 2024-03-18T18:05:56.606 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-03-18T18:05:56.647 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-18T18:05:57.001 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-psutil. 2024-03-18T18:05:57.019 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-03-18T18:05:57.059 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-03-18T18:05:57.388 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-18T18:05:57.405 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-03-18T18:05:57.454 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-03-18T18:05:57.791 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplejson. 2024-03-18T18:05:57.807 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-03-18T18:05:57.849 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-03-18T18:05:58.127 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-18T18:05:58.146 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-03-18T18:05:58.185 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-03-18T18:05:58.634 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-03-18T18:05:58.650 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-ceph_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:58.692 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:58.898 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw. 2024-03-18T18:05:58.918 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../116-radosgw_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:58.956 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:59.044 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-03-18T18:05:59.060 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-ceph-fuse_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:59.102 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:05:59.547 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-03-18T18:05:59.563 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-ceph-mds_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:05:59.605 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:00.192 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-03-18T18:06:00.208 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-cephadm_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:00.250 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:00.335 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse. 2024-03-18T18:06:00.352 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../117-rbd-fuse_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:00.393 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:00.561 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-18T18:06:00.576 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2024-03-18T18:06:00.619 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-03-18T18:06:00.699 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-attr (19.3.0-2) ... 2024-03-18T18:06:00.988 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-03-18T18:06:00.999 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-03-18T18:06:01.006 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-03-18T18:06:01.047 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-03-18T18:06:01.150 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-03-18T18:06:01.268 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-03-18T18:06:01.374 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-18T18:06:01.393 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:01.432 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:01.470 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:01.794 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-18T18:06:01.811 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-03-18T18:06:01.852 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-03-18T18:06:02.055 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user cephadm....done 2024-03-18T18:06:02.171 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jwt. 2024-03-18T18:06:02.190 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-03-18T18:06:02.219 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:06:02.229 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-03-18T18:06:02.345 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-03-18T18:06:02.566 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-attr. 2024-03-18T18:06:02.583 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-03-18T18:06:02.624 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-03-18T18:06:02.705 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-18T18:06:02.943 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-03-18T18:06:02.960 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-03-18T18:06:03.001 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-03-18T18:06:03.015 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:06:03.141 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-03-18T18:06:03.267 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-03-18T18:06:03.329 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-03-18T18:06:03.344 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-03-18T18:06:03.387 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-03-18T18:06:03.586 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-03-18T18:06:03.749 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-atomicwrites. 2024-03-18T18:06:03.768 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-03-18T18:06:03.807 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-03-18T18:06:04.022 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-03-18T18:06:04.093 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-packaging. 2024-03-18T18:06:04.108 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-03-18T18:06:04.151 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-packaging (20.3-1) ... 2024-03-18T18:06:04.324 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-03-18T18:06:04.470 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-03-18T18:06:04.489 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-03-18T18:06:04.528 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-03-18T18:06:04.617 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-03-18T18:06:04.878 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-18T18:06:04.897 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-03-18T18:06:04.985 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-18T18:06:05.010 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-03-18T18:06:05.286 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-03-18T18:06:05.589 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjs-underscore. 2024-03-18T18:06:05.609 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-03-18T18:06:05.612 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-argparse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:05.654 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-03-18T18:06:05.914 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-03-18T18:06:05.923 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-03-18T18:06:05.942 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-03-18T18:06:05.982 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-03-18T18:06:06.040 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-03-18T18:06:06.309 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-03-18T18:06:06.329 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-03-18T18:06:06.332 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-03-18T18:06:06.367 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-03-18T18:06:06.634 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-03-18T18:06:06.687 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-18T18:06:06.703 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:06.745 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:06.910 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-03-18T18:06:07.061 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-03-18T18:06:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-decorator. 2024-03-18T18:06:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-03-18T18:06:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-03-18T18:06:07.446 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-03-18T18:06:07.634 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-03-18T18:06:07.653 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-03-18T18:06:07.692 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-03-18T18:06:07.756 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-03-18T18:06:07.978 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-scipy. 2024-03-18T18:06:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-03-18T18:06:08.053 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-03-18T18:06:08.057 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-03-18T18:06:08.409 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-03-18T18:06:08.718 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-03-18T18:06:09.061 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-03-18T18:06:09.370 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-packaging (20.3-1) ... 2024-03-18T18:06:09.399 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-03-18T18:06:09.416 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-03-18T18:06:09.457 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-03-18T18:06:09.672 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-03-18T18:06:09.790 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-03-18T18:06:09.916 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-03-18T18:06:10.025 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-03-18T18:06:10.043 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-03-18T18:06:10.083 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-03-18T18:06:10.470 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-03-18T18:06:10.489 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-03-18T18:06:10.528 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-03-18T18:06:10.542 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-03-18T18:06:10.948 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-03-18T18:06:11.220 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-18T18:06:11.236 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:11.257 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-03-18T18:06:11.277 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:11.626 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-03-18T18:06:11.994 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up socat (1.7.3.3-2) ... 2024-03-18T18:06:12.154 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:12.431 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-03-18T18:06:12.447 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-03-18T18:06:12.480 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:06:12.488 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-03-18T18:06:12.607 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-03-18T18:06:12.910 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-18T18:06:12.927 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-03-18T18:06:12.968 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-03-18T18:06:12.992 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-03-18T18:06:13.118 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-03-18T18:06:13.244 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-03-18T18:06:13.297 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-18T18:06:13.314 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-03-18T18:06:13.355 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-03-18T18:06:13.537 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-03-18T18:06:13.709 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-03-18T18:06:13.727 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-03-18T18:06:13.767 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.0-3) ... 2024-03-18T18:06:13.855 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:06:13.984 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-03-18T18:06:14.087 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-03-18T18:06:14.103 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-03-18T18:06:14.110 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-03-18T18:06:14.170 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-03-18T18:06:14.429 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-03-18T18:06:14.490 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-blinker. 2024-03-18T18:06:14.509 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-03-18T18:06:14.548 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-03-18T18:06:14.722 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-03-18T18:06:14.868 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-oauthlib. 2024-03-18T18:06:14.884 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-03-18T18:06:14.926 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-03-18T18:06:15.015 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-03-18T18:06:15.141 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-18T18:06:15.229 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-18T18:06:15.249 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-03-18T18:06:15.287 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-03-18T18:06:15.443 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-03-18T18:06:15.623 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-03-18T18:06:15.639 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-03-18T18:06:15.682 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-03-18T18:06:15.769 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-03-18T18:06:16.019 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-18T18:06:16.035 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-03-18T18:06:16.078 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-03-18T18:06:16.112 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-03-18T18:06:16.516 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-03-18T18:06:16.624 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-18T18:06:16.640 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:16.682 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:16.783 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-03-18T18:06:16.909 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-03-18T18:06:17.009 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-18T18:06:17.027 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-03-18T18:06:17.067 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-03-18T18:06:17.244 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-03-18T18:06:17.446 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-18T18:06:17.463 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:06:17.504 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:06:17.612 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-03-18T18:06:17.747 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-03-18T18:06:17.798 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-03-18T18:06:17.815 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:06:17.856 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:06:17.873 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-03-18T18:06:18.109 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-03-18T18:06:18.124 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-03-18T18:06:18.167 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.3.3-2) ... 2024-03-18T18:06:18.191 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-03-18T18:06:18.492 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-03-18T18:06:18.495 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-03-18T18:06:18.514 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-03-18T18:06:18.553 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-03-18T18:06:18.891 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-03-18T18:06:18.907 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-ceph-test_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:18.949 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:19.966 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:06:20.092 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-03-18T18:06:20.485 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-03-18T18:06:20.820 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-03-18T18:06:21.113 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:06:21.239 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-03-18T18:06:21.574 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-03-18T18:06:21.901 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-03-18T18:06:22.286 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-03-18T18:06:22.621 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-03-18T18:06:23.528 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-03-18T18:06:23.544 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:23.585 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:23.669 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-03-18T18:06:23.795 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-03-18T18:06:23.946 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:06:23.981 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-18T18:06:23.999 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:24.039 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephfs-mirror (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:24.072 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rsa (4.0-3) ... 2024-03-18T18:06:24.351 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-colorama. 2024-03-18T18:06:24.357 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-03-18T18:06:24.370 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-03-18T18:06:24.400 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-03-18T18:06:24.483 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-03-18T18:06:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephfs-shell. 2024-03-18T18:06:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-cephfs-shell_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephfs-shell (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:24.818 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-03-18T18:06:24.997 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephfs-top. 2024-03-18T18:06:25.015 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-cephfs-top_18.2.2-914-g49bdc511-1focal_all.deb ... 2024-03-18T18:06:25.056 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephfs-top (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:25.111 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-18T18:06:25.350 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package fonts-mathjax. 2024-03-18T18:06:25.367 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-03-18T18:06:25.408 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:06:25.429 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-03-18T18:06:25.799 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:25.954 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-18T18:06:25.971 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:26.002 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-03-18T18:06:26.011 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:26.128 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:26.254 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libsqlite3-mod-ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:26.381 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-03-18T18:06:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-03-18T18:06:26.507 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-03-18T18:06:26.532 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-routes (2.4.1-2) ... 2024-03-18T18:06:26.803 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-18T18:06:26.808 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:26.820 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-03-18T18:06:26.861 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-03-18T18:06:26.935 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-03-18T18:06:27.228 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:27.264 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjs-mathjax. 2024-03-18T18:06:27.283 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-03-18T18:06:27.322 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:06:27.379 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-modules-core (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:27.506 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:27.726 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-18T18:06:27.727 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-18T18:06:28.208 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs-dev (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:28.334 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rados (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:28.460 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-top (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:28.586 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-03-18T18:06:28.997 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-natsort-doc. 2024-03-18T18:06:29.017 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-03-18T18:06:29.057 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-03-18T18:06:29.411 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webencodings. 2024-03-18T18:06:29.429 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-03-18T18:06:29.469 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-03-18T18:06:29.491 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rbd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:29.609 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:29.735 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:29.772 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-html5lib. 2024-03-18T18:06:29.789 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-03-18T18:06:29.830 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-03-18T18:06:29.894 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cephfs (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:30.021 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-shell (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:30.147 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:30.192 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-03-18T18:06:30.208 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-03-18T18:06:30.250 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-03-18T18:06:30.675 INFO:teuthology.orchestra.run.smithi094.stdout:Adding group ceph....done 2024-03-18T18:06:30.722 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-03-18T18:06:30.739 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-03-18T18:06:30.780 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-18T18:06:31.078 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user ceph....done 2024-03-18T18:06:31.125 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-03-18T18:06:31.143 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-03-18T18:06:31.183 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-03-18T18:06:31.237 INFO:teuthology.orchestra.run.smithi094.stdout:Setting system user ceph properties....done 2024-03-18T18:06:31.264 INFO:teuthology.orchestra.run.smithi094.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-18T18:06:31.414 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-18T18:06:31.511 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-18T18:06:31.528 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-03-18T18:06:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-03-18T18:06:31.733 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-18T18:06:31.914 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-03-18T18:06:31.932 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-03-18T18:06:31.972 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-03-18T18:06:32.192 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-mirror (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:32.250 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-18T18:06:32.267 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-03-18T18:06:32.308 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-03-18T18:06:32.417 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-18T18:06:32.417 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-18T18:06:32.860 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:32.986 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:33.053 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-03-18T18:06:33.074 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-radosgw_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:33.111 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:33.460 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-18T18:06:33.461 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-18T18:06:33.905 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-base (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:34.323 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-18T18:06:34.514 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-03-18T18:06:34.532 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-rbd-fuse_18.2.2-914-g49bdc511-1focal_amd64.deb ... 2024-03-18T18:06:34.572 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:34.757 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:34.882 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-attr (19.3.0-2) ... 2024-03-18T18:06:34.988 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-18T18:06:34.988 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-18T18:06:35.194 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-03-18T18:06:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-03-18T18:06:35.434 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-03-18T18:06:35.664 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-18T18:06:35.664 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-18T18:06:35.672 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:36.095 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:36.532 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-03-18T18:06:36.601 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-18T18:06:36.601 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-18T18:06:36.725 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:06:36.863 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-03-18T18:06:37.047 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-k8sevents (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:37.181 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:37.214 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-18T18:06:37.316 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:37.490 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-03-18T18:06:37.543 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-18T18:06:37.543 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-18T18:06:37.591 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-03-18T18:06:37.717 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-03-18T18:06:37.984 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:38.044 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-03-18T18:06:38.127 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:38.253 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dashboard (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:38.421 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-volume (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:38.454 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-03-18T18:06:38.772 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-03-18T18:06:38.783 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-03-18T18:06:38.935 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-03-18T18:06:39.048 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-03-18T18:06:39.203 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-03-18T18:06:39.317 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-03-18T18:06:39.592 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-03-18T18:06:39.877 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:40.169 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-03-18T18:06:40.287 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-03-18T18:06:40.572 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-03-18T18:06:40.856 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-03-18T18:06:41.149 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-03-18T18:06:41.275 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-03-18T18:06:41.660 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-03-18T18:06:41.944 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-03-18T18:06:42.107 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-03-18T18:06:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-03-18T18:06:42.513 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-03-18T18:06:42.750 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-18T18:06:42.753 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-18T18:06:42.825 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-03-18T18:06:42.831 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-03-18T18:06:43.036 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-03-18T18:06:43.036 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-03-18T18:06:43.157 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-03-18T18:06:43.249 INFO:teuthology.orchestra.run.smithi094.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout:flex is already the newest version (2.6.4-6.2). 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-03-18T18:06:43.250 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-18T18:06:43.251 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-03-18T18:06:43.251 INFO:teuthology.orchestra.run.smithi094.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-03-18T18:06:43.251 INFO:teuthology.orchestra.run.smithi094.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-03-18T18:06:43.252 INFO:teuthology.orchestra.run.smithi094.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-03-18T18:06:43.252 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-03-18T18:06:43.252 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch-data wpasupplicant 2024-03-18T18:06:43.253 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-03-18T18:06:43.253 INFO:teuthology.orchestra.run.smithi094.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-03-18T18:06:43.253 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-03-18T18:06:43.253 INFO:teuthology.orchestra.run.smithi094.stdout: libengine-pkcs11-openssl 2024-03-18T18:06:43.318 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-03-18T18:06:43.318 INFO:teuthology.orchestra.run.smithi094.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-03-18T18:06:43.319 INFO:teuthology.orchestra.run.smithi094.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-03-18T18:06:43.319 INFO:teuthology.orchestra.run.smithi094.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-03-18T18:06:43.319 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-03-18T18:06:43.319 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-03-18T18:06:43.319 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-18T18:06:43.320 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-03-18T18:06:43.321 INFO:teuthology.orchestra.run.smithi094.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-03-18T18:06:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-packaging (20.3-1) ... 2024-03-18T18:06:43.507 INFO:teuthology.orchestra.run.smithi094.stdout:6 upgraded, 31 newly installed, 0 to remove and 268 not upgraded. 2024-03-18T18:06:43.507 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 25.3 MB of archives. 2024-03-18T18:06:43.507 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 79.9 MB of additional disk space will be used. 2024-03-18T18:06:43.508 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2024-03-18T18:06:43.751 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-03-18T18:06:43.877 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-03-18T18:06:44.037 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-03-18T18:06:44.126 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2024-03-18T18:06:44.127 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2024-03-18T18:06:44.128 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-03-18T18:06:44.141 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-03-18T18:06:44.143 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-03-18T18:06:44.241 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-03-18T18:06:44.244 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-03-18T18:06:44.251 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-03-18T18:06:44.256 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-03-18T18:06:44.257 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-03-18T18:06:44.304 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-03-18T18:06:44.424 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-03-18T18:06:44.689 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-03-18T18:06:44.702 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-03-18T18:06:44.834 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-03-18T18:06:44.841 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-03-18T18:06:44.934 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-03-18T18:06:44.938 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-03-18T18:06:44.982 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-03-18T18:06:45.020 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.18-0ubuntu0.20.04.1 [116 kB] 2024-03-18T18:06:45.036 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-03-18T18:06:45.104 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-03-18T18:06:45.105 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-03-18T18:06:45.188 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-03-18T18:06:45.350 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-03-18T18:06:45.353 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-03-18T18:06:45.713 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.3.3-2) ... 2024-03-18T18:06:45.889 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:45.960 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-03-18T18:06:46.060 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-03-18T18:06:46.148 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-03-18T18:06:46.158 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-03-18T18:06:46.159 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-03-18T18:06:46.160 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-03-18T18:06:46.161 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.18-0ubuntu0.20.04.1 [1,054 kB] 2024-03-18T18:06:46.193 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-03-18T18:06:46.198 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.18-0ubuntu0.20.04.1 [13.5 MB] 2024-03-18T18:06:46.207 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:06:46.342 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-03-18T18:06:46.595 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-03-18T18:06:46.685 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-03-18T18:06:46.811 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-03-18T18:06:46.838 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-03-18T18:06:46.920 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-03-18T18:06:46.921 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-03-18T18:06:46.922 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-03-18T18:06:47.035 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-03-18T18:06:47.213 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-03-18T18:06:47.506 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:06:47.538 INFO:teuthology.orchestra.run.smithi094.stdout:Preconfiguring packages ... 2024-03-18T18:06:47.632 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-03-18T18:06:47.745 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 25.3 MB in 4s (6,675 kB/s) 2024-03-18T18:06:47.783 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-03-18T18:06:48.025 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152783 files and directories currently installed.) 2024-03-18T18:06:48.030 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2024-03-18T18:06:48.102 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-03-18T18:06:48.194 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-03-18T18:06:48.389 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-03-18T18:06:48.682 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-03-18T18:06:48.808 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-18T18:06:49.109 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-03-18T18:06:49.410 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-03-18T18:06:49.428 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2024-03-18T18:06:49.736 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-03-18T18:06:50.129 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-03-18T18:06:50.389 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-03-18T18:06:50.506 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-03-18T18:06:50.828 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152783 files and directories currently installed.) 2024-03-18T18:06:50.833 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2024-03-18T18:06:50.849 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-03-18T18:06:50.964 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-03-18T18:06:51.210 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-03-18T18:06:51.378 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-03-18T18:06:51.382 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2024-03-18T18:06:51.504 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-03-18T18:06:51.847 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-03-18T18:06:52.011 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-03-18T18:06:52.156 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-03-18T18:06:53.411 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2024-03-18T18:06:53.637 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:06:53.788 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-03-18T18:06:54.004 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152783 files and directories currently installed.) 2024-03-18T18:06:54.009 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-03-18T18:06:54.143 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-03-18T18:06:54.156 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-03-18T18:06:54.457 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-03-18T18:06:54.632 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-03-18T18:06:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-03-18T18:06:54.766 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-03-18T18:06:54.884 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-03-18T18:06:55.252 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-03-18T18:06:55.263 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-03-18T18:06:55.409 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-03-18T18:06:55.570 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-03-18T18:06:55.910 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-18T18:06:55.927 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-03-18T18:06:55.968 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-03-18T18:06:55.980 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-03-18T18:06:56.306 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-03-18T18:06:56.338 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package dump. 2024-03-18T18:06:56.355 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-03-18T18:06:56.396 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking dump (0.4b46-6) ... 2024-03-18T18:06:56.701 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package indent. 2024-03-18T18:06:56.718 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:06:56.759 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-03-18T18:06:57.037 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-18T18:06:57.054 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-03-18T18:06:57.087 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-03-18T18:06:57.328 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-03-18T18:06:57.449 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-18T18:06:57.467 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-03-18T18:06:57.488 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-03-18T18:06:57.507 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-03-18T18:06:57.614 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-03-18T18:06:57.740 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.0-3) ... 2024-03-18T18:06:57.778 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-18T18:06:57.795 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-03-18T18:06:57.836 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:06:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-03-18T18:06:58.189 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-18T18:06:58.192 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-03-18T18:06:58.207 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:06:58.248 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:06:58.501 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-03-18T18:06:58.526 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-18T18:06:58.543 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:06:58.622 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:06:58.786 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-18T18:06:59.104 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-03-18T18:06:59.464 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:59.675 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-03-18T18:06:59.801 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:06:59.934 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-18T18:06:59.954 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:06:59.960 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:00.087 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:00.195 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:00.213 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.4.1-2) ... 2024-03-18T18:07:00.515 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:00.553 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-18T18:07:00.571 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-03-18T18:07:00.640 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-03-18T18:07:00.644 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-03-18T18:07:00.950 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:00.973 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-18T18:07:00.989 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-03-18T18:07:01.031 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:01.110 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:01.235 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:01.418 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-18T18:07:01.435 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../14-libpq5_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:01.469 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-18T18:07:01.470 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-18T18:07:01.492 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:01.855 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-18T18:07:01.871 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:01.887 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:01.913 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:02.030 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:02.148 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephfs-top (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:02.249 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-03-18T18:07:02.292 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-18T18:07:02.309 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:02.357 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:02.602 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-18T18:07:02.621 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-03-18T18:07:02.660 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-03-18T18:07:03.169 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:03.190 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-18T18:07:03.207 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-03-18T18:07:03.248 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-03-18T18:07:03.303 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:03.429 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:03.589 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:03.635 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package modemmanager. 2024-03-18T18:07:03.654 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:03.698 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephfs-shell (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:03.704 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:03.832 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:04.334 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package wpasupplicant. 2024-03-18T18:07:04.351 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-03-18T18:07:04.392 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-03-18T18:07:04.396 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-03-18T18:07:04.830 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-03-18T18:07:04.973 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager. 2024-03-18T18:07:04.990 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-03-18T18:07:05.007 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-03-18T18:07:05.032 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-18T18:07:05.056 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:05.185 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-18T18:07:05.499 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-18T18:07:05.824 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ppp. 2024-03-18T18:07:05.840 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-03-18T18:07:05.977 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephfs-mirror (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:06.111 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-03-18T18:07:06.200 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-18T18:07:06.200 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-18T18:07:06.446 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pptp-linux. 2024-03-18T18:07:06.463 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-03-18T18:07:06.530 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-03-18T18:07:06.645 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:06.771 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:06.883 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-18T18:07:06.902 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-03-18T18:07:06.959 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-03-18T18:07:07.204 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-18T18:07:07.222 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-03-18T18:07:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-18T18:07:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-18T18:07:07.253 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-03-18T18:07:07.584 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-12. 2024-03-18T18:07:07.601 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../26-postgresql-client-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:07.642 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:07.698 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:08.089 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-18T18:07:08.281 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-common. 2024-03-18T18:07:08.299 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-03-18T18:07:08.363 INFO:teuthology.orchestra.run.smithi094.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-18T18:07:08.391 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-03-18T18:07:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-18T18:07:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-18T18:07:08.855 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-12. 2024-03-18T18:07:08.874 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../28-postgresql-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:08.917 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:09.244 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:09.469 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-18T18:07:09.469 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-18T18:07:09.903 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:10.400 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-18T18:07:10.400 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-18T18:07:10.669 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql. 2024-03-18T18:07:10.688 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-03-18T18:07:10.727 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-03-18T18:07:10.863 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:10.981 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:11.005 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client. 2024-03-18T18:07:11.022 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-03-18T18:07:11.063 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-03-18T18:07:11.099 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:11.291 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-18T18:07:11.305 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-18T18:07:11.305 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-18T18:07:11.309 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-03-18T18:07:11.349 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-03-18T18:07:11.610 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-18T18:07:11.627 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-03-18T18:07:11.693 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-03-18T18:07:11.733 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:11.868 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:11.969 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:12.072 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-18T18:07:12.093 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-03-18T18:07:12.111 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (18.2.2-914-g49bdc511-1focal) ... 2024-03-18T18:07:12.140 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-03-18T18:07:12.442 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-03-18T18:07:12.490 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-03-18T18:07:12.687 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-03-18T18:07:12.854 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-03-18T18:07:12.997 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:13.118 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-03-18T18:07:13.123 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-03-18T18:07:13.250 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-03-18T18:07:13.401 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-03-18T18:07:13.797 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-18T18:07:13.797 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-18T18:07:14.297 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:15.182 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-18T18:07:15.270 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2024-03-18T18:07:15.396 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-03-18T18:07:15.701 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-03-18T18:07:15.987 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-03-18T18:07:16.562 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-18T18:07:16.565 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-18T18:07:16.639 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-03-18T18:07:16.849 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-03-18T18:07:16.850 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-03-18T18:07:17.060 INFO:teuthology.orchestra.run.smithi151.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-03-18T18:07:17.061 INFO:teuthology.orchestra.run.smithi151.stdout:flex is already the newest version (2.6.4-6.2). 2024-03-18T18:07:17.061 INFO:teuthology.orchestra.run.smithi151.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-03-18T18:07:17.061 INFO:teuthology.orchestra.run.smithi151.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-03-18T18:07:17.061 INFO:teuthology.orchestra.run.smithi151.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-03-18T18:07:17.061 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-03-18T18:07:17.061 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-03-18T18:07:17.062 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-18T18:07:17.062 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-03-18T18:07:17.062 INFO:teuthology.orchestra.run.smithi151.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-03-18T18:07:17.062 INFO:teuthology.orchestra.run.smithi151.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-03-18T18:07:17.063 INFO:teuthology.orchestra.run.smithi151.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-03-18T18:07:17.063 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-03-18T18:07:17.063 INFO:teuthology.orchestra.run.smithi151.stdout: usb-modeswitch-data wpasupplicant 2024-03-18T18:07:17.064 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-03-18T18:07:17.064 INFO:teuthology.orchestra.run.smithi151.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-03-18T18:07:17.064 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-03-18T18:07:17.065 INFO:teuthology.orchestra.run.smithi151.stdout: libengine-pkcs11-openssl 2024-03-18T18:07:17.129 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-03-18T18:07:17.129 INFO:teuthology.orchestra.run.smithi151.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-03-18T18:07:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-03-18T18:07:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-03-18T18:07:17.130 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-03-18T18:07:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-03-18T18:07:17.131 INFO:teuthology.orchestra.run.smithi151.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-18T18:07:17.131 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-03-18T18:07:17.133 INFO:teuthology.orchestra.run.smithi151.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-03-18T18:07:17.209 INFO:teuthology.orchestra.run.smithi151.stdout:6 upgraded, 31 newly installed, 0 to remove and 268 not upgraded. 2024-03-18T18:07:17.209 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 25.3 MB of archives. 2024-03-18T18:07:17.209 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 79.9 MB of additional disk space will be used. 2024-03-18T18:07:17.209 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2024-03-18T18:07:17.346 INFO:teuthology.orchestra.run.smithi094.stdout:Adding user postgres to group ssl-cert 2024-03-18T18:07:17.422 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2024-03-18T18:07:17.423 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2024-03-18T18:07:17.424 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-03-18T18:07:17.431 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-03-18T18:07:17.432 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-03-18T18:07:17.477 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-03-18T18:07:17.479 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-03-18T18:07:17.486 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-03-18T18:07:17.488 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-03-18T18:07:17.488 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-03-18T18:07:17.495 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-03-18T18:07:17.496 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-03-18T18:07:17.499 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-03-18T18:07:17.499 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-03-18T18:07:17.529 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-03-18T18:07:17.530 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-03-18T18:07:17.538 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.18-0ubuntu0.20.04.1 [116 kB] 2024-03-18T18:07:17.541 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-03-18T18:07:17.549 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-03-18T18:07:17.549 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-03-18T18:07:17.592 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-03-18T18:07:17.593 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-03-18T18:07:17.598 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:17.598 INFO:teuthology.orchestra.run.smithi094.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-18T18:07:17.610 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-03-18T18:07:17.643 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-03-18T18:07:17.731 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-03-18T18:07:17.734 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-03-18T18:07:17.734 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-03-18T18:07:17.735 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-03-18T18:07:17.735 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.18-0ubuntu0.20.04.1 [1,054 kB] 2024-03-18T18:07:17.744 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-03-18T18:07:17.746 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.18-0ubuntu0.20.04.1 [13.5 MB] 2024-03-18T18:07:17.869 INFO:teuthology.orchestra.run.smithi094.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-18T18:07:17.870 INFO:teuthology.orchestra.run.smithi094.stdout:Removing obsolete dictionary files: 2024-03-18T18:07:17.985 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-03-18T18:07:17.986 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-03-18T18:07:18.061 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-03-18T18:07:18.062 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-03-18T18:07:18.062 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-03-18T18:07:18.196 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-18T18:07:18.474 INFO:teuthology.orchestra.run.smithi151.stdout:Preconfiguring packages ... 2024-03-18T18:07:18.658 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 25.3 MB in 1s (27.5 MB/s) 2024-03-18T18:07:18.890 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152783 files and directories currently installed.) 2024-03-18T18:07:18.895 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2024-03-18T18:07:18.959 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-03-18T18:07:19.032 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-03-18T18:07:19.094 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-03-18T18:07:19.220 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:19.346 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-03-18T18:07:20.175 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2024-03-18T18:07:20.292 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-03-18T18:07:20.536 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up dump (0.4b46-6) ... 2024-03-18T18:07:20.633 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-18T18:07:20.696 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:20.823 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-03-18T18:07:20.949 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-03-18T18:07:21.075 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-03-18T18:07:21.268 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-03-18T18:07:21.411 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:21.584 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152783 files and directories currently installed.) 2024-03-18T18:07:21.589 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2024-03-18T18:07:21.721 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-03-18T18:07:21.785 INFO:teuthology.orchestra.run.smithi094.stdout:Creating new PostgreSQL cluster 12/main ... 2024-03-18T18:07:21.801 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout:This user must also own the server process. 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout:The database cluster will be initialized with locale "en_US". 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout:The default text search configuration will be set to "english". 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:21.861 INFO:teuthology.orchestra.run.smithi094.stdout:Data page checksums are disabled. 2024-03-18T18:07:21.862 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:21.862 INFO:teuthology.orchestra.run.smithi094.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-03-18T18:07:21.862 INFO:teuthology.orchestra.run.smithi094.stdout:creating subdirectories ... ok 2024-03-18T18:07:21.862 INFO:teuthology.orchestra.run.smithi094.stdout:selecting dynamic shared memory implementation ... posix 2024-03-18T18:07:21.882 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default max_connections ... 100 2024-03-18T18:07:21.900 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default shared_buffers ... 128MB 2024-03-18T18:07:21.917 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default time zone ... Etc/UTC 2024-03-18T18:07:21.918 INFO:teuthology.orchestra.run.smithi094.stdout:creating configuration files ... ok 2024-03-18T18:07:22.026 INFO:teuthology.orchestra.run.smithi094.stdout:running bootstrap script ... ok 2024-03-18T18:07:22.139 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2024-03-18T18:07:22.319 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2024-03-18T18:07:22.517 INFO:teuthology.orchestra.run.smithi094.stdout:performing post-bootstrap initialization ... ok 2024-03-18T18:07:22.671 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2024-03-18T18:07:23.290 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152783 files and directories currently installed.) 2024-03-18T18:07:23.295 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-03-18T18:07:23.428 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-03-18T18:07:23.529 INFO:teuthology.orchestra.run.smithi094.stdout:syncing data to disk ... ok 2024-03-18T18:07:23.530 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:23.530 INFO:teuthology.orchestra.run.smithi094.stdout:Success. You can now start the database server using: 2024-03-18T18:07:23.530 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:23.530 INFO:teuthology.orchestra.run.smithi094.stdout: pg_ctlcluster 12 main start 2024-03-18T18:07:23.530 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:23.850 INFO:teuthology.orchestra.run.smithi094.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-03-18T18:07:23.850 INFO:teuthology.orchestra.run.smithi094.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-03-18T18:07:23.913 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-18T18:07:23.917 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-03-18T18:07:24.042 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-03-18T18:07:24.546 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-03-18T18:07:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-03-18T18:07:25.242 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-18T18:07:25.260 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-03-18T18:07:25.300 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-03-18T18:07:25.678 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package dump. 2024-03-18T18:07:25.696 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-03-18T18:07:25.738 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking dump (0.4b46-6) ... 2024-03-18T18:07:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package indent. 2024-03-18T18:07:26.067 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:26.106 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-03-18T18:07:26.451 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-18T18:07:26.468 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-03-18T18:07:26.509 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-03-18T18:07:26.880 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-18T18:07:26.898 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-03-18T18:07:26.938 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-03-18T18:07:26.995 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:27.146 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:07:27.199 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-18T18:07:27.216 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-03-18T18:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:27.272 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-03-18T18:07:27.457 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:27.583 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-03-18T18:07:27.610 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-18T18:07:27.630 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:27.668 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:07:27.709 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:27.946 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-18T18:07:27.966 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:28.046 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:07:28.433 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:28.434 INFO:teuthology.orchestra.run.smithi094.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-18T18:07:28.434 INFO:teuthology.orchestra.run.smithi094.stdout:which means they are currently configured by ifupdown: 2024-03-18T18:07:28.434 INFO:teuthology.orchestra.run.smithi094.stdout:- enp3s0f1 2024-03-18T18:07:28.434 INFO:teuthology.orchestra.run.smithi094.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-18T18:07:28.434 INFO:teuthology.orchestra.run.smithi094.stdout:remove their configuration from /etc/network/interfaces. 2024-03-18T18:07:28.434 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:07:28.483 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-18T18:07:28.502 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:28.586 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-18T18:07:28.684 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:28.915 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-18T18:07:29.037 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-18T18:07:29.054 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-03-18T18:07:29.095 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-03-18T18:07:29.458 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-18T18:07:29.465 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-18T18:07:29.482 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-03-18T18:07:29.523 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:29.926 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-18T18:07:29.944 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../14-libpq5_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:29.946 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:07:29.984 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:30.090 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-03-18T18:07:30.233 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:30.337 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-18T18:07:30.356 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:30.359 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-03-18T18:07:30.387 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:30.518 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-03-18T18:07:30.645 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:30.706 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-18T18:07:30.724 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:30.762 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:30.765 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:30.889 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:31.017 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-18T18:07:31.034 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-03-18T18:07:31.100 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-03-18T18:07:31.157 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-18T18:07:31.157 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-18T18:07:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-18T18:07:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-03-18T18:07:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-03-18T18:07:31.658 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-03-18T18:07:31.759 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-18T18:07:31.869 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-03-18T18:07:32.021 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-03-18T18:07:32.032 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package modemmanager. 2024-03-18T18:07:32.049 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-03-18T18:07:32.100 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:32.314 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-03-18T18:07:32.788 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package wpasupplicant. 2024-03-18T18:07:32.805 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-03-18T18:07:32.880 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-03-18T18:07:33.410 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package network-manager. 2024-03-18T18:07:33.427 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-03-18T18:07:33.518 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:34.469 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ppp. 2024-03-18T18:07:34.485 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-03-18T18:07:34.744 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-03-18T18:07:35.074 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pptp-linux. 2024-03-18T18:07:35.094 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-03-18T18:07:35.132 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-03-18T18:07:35.519 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-18T18:07:35.538 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-03-18T18:07:35.595 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-03-18T18:07:35.939 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-18T18:07:35.958 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-03-18T18:07:35.997 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-03-18T18:07:36.301 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-client-12. 2024-03-18T18:07:36.322 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../26-postgresql-client-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:36.359 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:36.999 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-common. 2024-03-18T18:07:37.015 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-03-18T18:07:37.079 INFO:teuthology.orchestra.run.smithi151.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-18T18:07:37.108 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-03-18T18:07:37.604 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-12. 2024-03-18T18:07:37.621 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../28-postgresql-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-03-18T18:07:37.665 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:39.561 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-03-18T18:07:39.661 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-03-18T18:07:40.049 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql. 2024-03-18T18:07:40.070 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-03-18T18:07:40.107 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-03-18T18:07:40.359 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-client. 2024-03-18T18:07:40.377 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-03-18T18:07:40.417 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-03-18T18:07:40.509 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-18T18:07:40.514 DEBUG:teuthology.parallel:result is None 2024-03-18T18:07:40.661 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-18T18:07:40.680 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-03-18T18:07:40.719 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-03-18T18:07:40.988 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-18T18:07:41.008 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-03-18T18:07:41.046 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-03-18T18:07:41.450 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-18T18:07:41.470 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-03-18T18:07:41.518 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-03-18T18:07:41.819 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-03-18T18:07:42.064 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-03-18T18:07:42.374 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:42.516 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-03-18T18:07:42.659 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-03-18T18:07:42.785 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-03-18T18:07:43.176 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-18T18:07:43.177 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-18T18:07:43.663 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:44.567 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-18T18:07:44.652 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2024-03-18T18:07:44.778 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-03-18T18:07:44.904 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-03-18T18:07:46.120 INFO:teuthology.orchestra.run.smithi151.stdout:Adding user postgres to group ssl-cert 2024-03-18T18:07:46.408 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:46.408 INFO:teuthology.orchestra.run.smithi151.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-18T18:07:46.641 INFO:teuthology.orchestra.run.smithi151.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-18T18:07:46.641 INFO:teuthology.orchestra.run.smithi151.stdout:Removing obsolete dictionary files: 2024-03-18T18:07:46.962 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-18T18:07:47.706 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-03-18T18:07:47.832 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-03-18T18:07:47.950 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:48.076 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-03-18T18:07:49.084 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-03-18T18:07:49.340 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up dump (0.4b46-6) ... 2024-03-18T18:07:49.437 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-18T18:07:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:07:49.617 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-03-18T18:07:49.743 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-03-18T18:07:49.869 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-03-18T18:07:50.070 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-03-18T18:07:50.605 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-03-18T18:07:50.993 INFO:teuthology.orchestra.run.smithi151.stdout:Creating new PostgreSQL cluster 12/main ... 2024-03-18T18:07:51.007 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-03-18T18:07:51.061 INFO:teuthology.orchestra.run.smithi151.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-18T18:07:51.061 INFO:teuthology.orchestra.run.smithi151.stdout:This user must also own the server process. 2024-03-18T18:07:51.061 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout:The database cluster will be initialized with locale "en_US". 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout:The default text search configuration will be set to "english". 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout:Data page checksums are disabled. 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-03-18T18:07:51.062 INFO:teuthology.orchestra.run.smithi151.stdout:creating subdirectories ... ok 2024-03-18T18:07:51.063 INFO:teuthology.orchestra.run.smithi151.stdout:selecting dynamic shared memory implementation ... posix 2024-03-18T18:07:51.082 INFO:teuthology.orchestra.run.smithi151.stdout:selecting default max_connections ... 100 2024-03-18T18:07:51.106 INFO:teuthology.orchestra.run.smithi151.stdout:selecting default shared_buffers ... 128MB 2024-03-18T18:07:51.117 INFO:teuthology.orchestra.run.smithi151.stdout:selecting default time zone ... Etc/UTC 2024-03-18T18:07:51.118 INFO:teuthology.orchestra.run.smithi151.stdout:creating configuration files ... ok 2024-03-18T18:07:51.224 INFO:teuthology.orchestra.run.smithi151.stdout:running bootstrap script ... ok 2024-03-18T18:07:51.743 INFO:teuthology.orchestra.run.smithi151.stdout:performing post-bootstrap initialization ... ok 2024-03-18T18:07:52.531 INFO:teuthology.orchestra.run.smithi151.stdout:syncing data to disk ... ok 2024-03-18T18:07:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:52.531 INFO:teuthology.orchestra.run.smithi151.stdout:Success. You can now start the database server using: 2024-03-18T18:07:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: pg_ctlcluster 12 main start 2024-03-18T18:07:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:52.834 INFO:teuthology.orchestra.run.smithi151.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-03-18T18:07:52.835 INFO:teuthology.orchestra.run.smithi151.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-03-18T18:07:52.914 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-18T18:07:55.978 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:56.138 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:07:56.255 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-03-18T18:07:56.423 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:56.549 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-03-18T18:07:56.700 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout:which means they are currently configured by ifupdown: 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout:- enp3s0f1 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout:remove their configuration from /etc/network/interfaces. 2024-03-18T18:07:57.375 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:07:57.532 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-18T18:07:57.858 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-18T18:07:58.387 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-18T18:07:58.878 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-03-18T18:07:59.023 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-03-18T18:07:59.191 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-03-18T18:07:59.317 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-03-18T18:07:59.443 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-03-18T18:07:59.568 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:59.736 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-03-18T18:07:59.862 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-03-18T18:08:00.136 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-18T18:08:00.136 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-18T18:08:00.665 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-03-18T18:08:00.765 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-18T18:08:00.925 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-03-18T18:08:01.076 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-03-18T18:08:01.369 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-03-18T18:08:08.924 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-03-18T18:08:09.041 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-03-18T18:08:09.892 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-18T18:08:09.900 DEBUG:teuthology.parallel:result is None 2024-03-18T18:08:09.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T18:08:10.237 DEBUG:teuthology.orchestra.run.smithi094:> dpkg-query -W -f '${Version}' ceph 2024-03-18T18:08:10.261 INFO:teuthology.orchestra.run.smithi094.stdout:18.2.2-914-g49bdc511-1focal 2024-03-18T18:08:10.261 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-914-g49bdc511-1focal 2024-03-18T18:08:10.261 INFO:teuthology.task.install:The correct ceph version 18.2.2-914-g49bdc511-1focal is installed. 2024-03-18T18:08:10.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T18:08:10.404 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-03-18T18:08:10.428 INFO:teuthology.orchestra.run.smithi151.stdout:18.2.2-914-g49bdc511-1focal 2024-03-18T18:08:10.428 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-914-g49bdc511-1focal 2024-03-18T18:08:10.429 INFO:teuthology.task.install:The correct ceph version 18.2.2-914-g49bdc511-1focal is installed. 2024-03-18T18:08:10.430 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-18T18:08:10.431 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:10.431 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T18:08:10.447 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:10.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T18:08:10.462 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-18T18:08:10.462 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:10.462 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T18:08:10.475 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T18:08:10.533 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:10.533 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T18:08:10.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T18:08:10.559 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-18T18:08:10.559 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:10.559 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T18:08:10.575 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T18:08:10.633 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:10.633 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T18:08:10.650 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T18:08:10.661 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-18T18:08:10.662 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:10.662 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T18:08:10.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T18:08:10.690 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:10.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T18:08:10.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T18:08:10.762 INFO:teuthology.run_tasks:Running task ceph... 2024-03-18T18:08:10.829 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-18T18:08:10.829 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-03-18T18:08:10.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-03-18T18:08:10.847 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-18T18:08:10.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T18:08:10.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T18:08:10.903 INFO:tasks.ceph:Creating extra log directories... 2024-03-18T18:08:10.903 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T18:08:10.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T18:08:10.969 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-18T18:08:10.969 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-18T18:08:10.969 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-18T18:08:10.969 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:10.969 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-18T18:08:10.976 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-18T18:08:11.016 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:11.016 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-18T18:08:11.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-18T18:08:11.062 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-18T18:08:11.062 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-18T18:08:11.062 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205', 'branch': 'wip-yuri10-testing-2024-03-15-1653-reef', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7606205', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2024-03-15-1653-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2024-03-15-1653-reef', 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8313, 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2024-03-15-1653-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '49bdc51142759622a281d3e5327eebd07cbb8bb3', 'cluster': 'ceph'}}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-16_15:03:17', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-18T18:08:11.063 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T18:08:11.065 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T18:08:11.071 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T18:08:11.112 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T18:08:11.131 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:11.131 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T18:08:11.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T18:08:11.136 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-03-18T18:08:11.143 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T18:08:11.143 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.144 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-03-18T18:08:11.144 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.144 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-18 18:03:05.615266091 +0000 2024-03-18T18:08:11.144 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-18 18:03:05.363271900 +0000 2024-03-18T18:08:11.144 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-18 18:03:05.363271900 +0000 2024-03-18T18:08:11.144 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-03-18T18:08:11.144 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T18:08:11.200 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-18T18:08:11.201 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-18T18:08:11.201 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000308354 s, 1.7 MB/s 2024-03-18T18:08:11.202 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T18:08:11.211 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-18 18:03:06.015256872 +0000 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-18 18:03:05.811261573 +0000 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-18 18:03:05.811261573 +0000 2024-03-18T18:08:11.217 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-03-18T18:08:11.217 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T18:08:11.272 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-18T18:08:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-18T18:08:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000306981 s, 1.7 MB/s 2024-03-18T18:08:11.274 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T18:08:11.282 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-18 18:03:06.447246914 +0000 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-18 18:03:06.219252169 +0000 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-18 18:03:06.219252169 +0000 2024-03-18T18:08:11.288 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-03-18T18:08:11.289 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T18:08:11.344 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-18T18:08:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-18T18:08:11.345 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000299074 s, 1.7 MB/s 2024-03-18T18:08:11.346 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T18:08:11.354 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-03-18T18:08:11.360 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T18:08:11.360 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.360 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-03-18T18:08:11.360 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.360 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-18 18:03:06.879236956 +0000 2024-03-18T18:08:11.361 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-18 18:03:06.667241842 +0000 2024-03-18T18:08:11.361 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-18 18:03:06.667241842 +0000 2024-03-18T18:08:11.361 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-03-18T18:08:11.361 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T18:08:11.417 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-18T18:08:11.417 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-18T18:08:11.417 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000296553 s, 1.7 MB/s 2024-03-18T18:08:11.418 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T18:08:11.425 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:11.425 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:11.425 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T18:08:11.432 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T18:08:11.432 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-03-18T18:08:11.439 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 355 Links: 1 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-18 18:03:05.544103062 +0000 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-18 18:03:05.332107939 +0000 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-18 18:03:05.332107939 +0000 2024-03-18T18:08:11.440 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-03-18T18:08:11.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T18:08:11.452 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-18T18:08:11.452 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-18T18:08:11.452 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000369306 s, 1.4 MB/s 2024-03-18T18:08:11.453 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T18:08:11.460 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 363 Links: 1 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-18 18:03:05.748098368 +0000 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-18 18:03:05.744098460 +0000 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-18 18:03:05.744098460 +0000 2024-03-18T18:08:11.466 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-03-18T18:08:11.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T18:08:11.521 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-18T18:08:11.522 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-18T18:08:11.522 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000396856 s, 1.3 MB/s 2024-03-18T18:08:11.522 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T18:08:11.531 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-18 18:03:06.436082539 +0000 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-18 18:03:06.204087877 +0000 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-18 18:03:06.204087877 +0000 2024-03-18T18:08:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-03-18T18:08:11.538 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T18:08:11.593 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-18T18:08:11.594 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-18T18:08:11.594 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000390164 s, 1.3 MB/s 2024-03-18T18:08:11.595 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T18:08:11.602 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-03-18T18:08:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T18:08:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T18:08:11.608 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-03-18T18:08:11.608 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T18:08:11.608 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-18 18:03:06.856072877 +0000 2024-03-18T18:08:11.608 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-18 18:03:06.648077662 +0000 2024-03-18T18:08:11.608 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-18 18:03:06.648077662 +0000 2024-03-18T18:08:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-03-18T18:08:11.608 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T18:08:11.665 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-18T18:08:11.665 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-18T18:08:11.665 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000373584 s, 1.4 MB/s 2024-03-18T18:08:11.666 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T18:08:11.673 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:11.673 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-18T18:08:11.673 INFO:tasks.ceph:Generating config... 2024-03-18T18:08:11.674 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-18T18:08:11.675 INFO:tasks.ceph:[client] debug client = 20 2024-03-18T18:08:11.675 INFO:tasks.ceph:[client] debug ms = 1 2024-03-18T18:08:11.675 INFO:tasks.ceph:[client] pid file = 2024-03-18T18:08:11.675 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-18T18:08:11.675 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-18T18:08:11.675 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-18T18:08:11.676 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-18T18:08:11.676 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-18T18:08:11.676 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-18T18:08:11.676 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-18T18:08:11.676 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-18T18:08:11.677 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-18T18:08:11.677 INFO:tasks.ceph:Setting up mon.a... 2024-03-18T18:08:11.678 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-18T18:08:11.717 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-03-18T18:08:11.728 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-18T18:08:11.816 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T18:08:11.831 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2024-03-18T18:08:11.832 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-18T18:08:11.834 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:11.834 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T18:08:11.839 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:11.883 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:11.883 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid 9be12cb7-8488-4090-a5db-a2b29f4bc5c3 2024-03-18T18:08:11.883 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = pacific 2024-03-18T18:08:11.883 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:fsid 9be12cb7-8488-4090-a5db-a2b29f4bc5c3 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-03-18T18:08:11.884752+0000 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-03-18T18:08:11.884752+0000 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 16 (pacific) 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2024-03-18T18:08:11.884 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-18T18:08:11.885 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T18:08:11.892 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9be12cb7-8488-4090-a5db-a2b29f4bc5c3... 2024-03-18T18:08:11.893 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T18:08:11.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T18:08:11.967 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-03-18T18:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-03-18T18:08:11.969 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-03-18T18:08:11.970 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 9be12cb7-8488-4090-a5db-a2b29f4bc5c3 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-03-18T18:08:11.971 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-03-18T18:08:11.972 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-03-18T18:08:11.973 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-03-18T18:08:11.974 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T18:08:11.975 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-03-18T18:08:11.976 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-03-18T18:08:11.977 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal fragment size max = 10000 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal merge size = 5 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal split bits = 3 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal split size = 100 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-03-18T18:08:11.978 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-03-18T18:08:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-03-18T18:08:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.94,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 9be12cb7-8488-4090-a5db-a2b29f4bc5c3 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-03-18T18:08:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-18T18:08:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-03-18T18:08:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-03-18T18:08:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2024-03-18T18:08:11.988 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal fragment size max = 10000 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal merge size = 5 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal split bits = 3 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal split size = 100 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2024-03-18T18:08:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2024-03-18T18:08:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2024-03-18T18:08:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2024-03-18T18:08:11.991 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-18T18:08:11.991 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-18T18:08:12.046 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-18T18:08:12.046 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:12.047 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-18T18:08:12.052 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:12.052 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-18T18:08:12.059 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:08:12.059 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:12.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T18:08:12.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T18:08:12.082 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:12.082 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:12.132 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:08:12.133 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:12.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T18:08:12.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T18:08:12.158 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:12.158 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:12.163 INFO:tasks.ceph:Setting up mon nodes... 2024-03-18T18:08:12.163 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-18T18:08:12.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T18:08:12.212 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T18:08:12.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T18:08:12.264 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T18:08:12.279 INFO:tasks.ceph:Setting up mds nodes... 2024-03-18T18:08:12.279 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T18:08:12.328 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T18:08:12.331 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-18T18:08:12.342 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T18:08:12.393 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T18:08:12.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-18T18:08:12.406 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-18T18:08:12.406 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-18T18:08:12.450 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-18T18:08:12.464 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-18T18:08:12.464 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-18T18:08:12.464 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-18T18:08:12.474 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:12.474 INFO:tasks.ceph:role: osd.0 2024-03-18T18:08:12.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:08:12.475 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T18:08:12.516 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:12.516 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:12.516 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:12.516 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-03-18T18:08:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:12.517 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:12.517 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:12.517 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:12.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-18T18:08:12.518 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-18T18:08:12.539 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-18T18:08:12.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:12.593 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:12.593 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-18T18:08:12.604 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:12.605 INFO:tasks.ceph:role: osd.1 2024-03-18T18:08:12.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:08:12.605 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T18:08:12.646 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:12.647 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:12.648 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-18T18:08:12.648 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-18T18:08:12.668 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-18T18:08:12.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:12.721 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:12.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-18T18:08:12.733 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:12.733 INFO:tasks.ceph:role: osd.2 2024-03-18T18:08:12.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:08:12.733 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T18:08:12.776 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:12.776 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:12.777 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:12.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-18T18:08:12.778 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-18T18:08:12.799 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-18T18:08:12.853 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:12.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:12.854 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-18T18:08:12.866 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:12.866 INFO:tasks.ceph:role: osd.3 2024-03-18T18:08:12.866 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:08:12.866 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:12.909 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:12.910 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:12.910 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-18T18:08:12.911 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-18T18:08:12.976 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-18T18:08:12.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:12.988 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:12.988 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:13.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:13.061+0000 7f4fa13a9700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-18T18:08:13.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:13.061+0000 7f4fa13a9700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-18T18:08:13.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:13.061+0000 7f4fa13a9700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T18:08:13.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:13.061+0000 7f4fa13a9700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T18:08:13.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:13.061+0000 7f4fa13a9700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T18:08:13.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:13.061+0000 7f4fa13a9700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-18T18:08:16.087 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-18T18:08:16.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:16.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:16.145+0000 7f15270e5700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-18T18:08:16.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:16.145+0000 7f15270e5700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-18T18:08:16.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:16.145+0000 7f15270e5700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T18:08:16.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:16.145+0000 7f15270e5700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T18:08:16.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:16.145+0000 7f15270e5700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T18:08:16.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:16.145+0000 7f15270e5700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-18T18:08:19.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-18T18:08:19.190 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:19.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:19.277+0000 7f03d7b7e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-18T18:08:19.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:19.277+0000 7f03d7b7e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-18T18:08:19.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:19.277+0000 7f03d7b7e700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T18:08:19.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:19.277+0000 7f03d7b7e700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T18:08:19.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:19.277+0000 7f03d7b7e700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T18:08:19.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:19.277+0000 7f03d7b7e700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-18T18:08:22.301 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-18T18:08:22.316 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:22.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:22.353+0000 7f3bcd1ed700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-18T18:08:22.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:22.357+0000 7f3bcd1ed700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-18T18:08:22.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:22.357+0000 7f3bcd1ed700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T18:08:22.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:22.357+0000 7f3bcd1ed700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T18:08:22.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:22.357+0000 7f3bcd1ed700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T18:08:22.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:22.357+0000 7f3bcd1ed700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-18T18:08:25.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-18T18:08:25.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-18T18:08:25.391 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:25.392 INFO:tasks.ceph:role: osd.4 2024-03-18T18:08:25.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:08:25.392 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T18:08:25.986 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:25.986 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:25.986 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:25.986 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2024-03-18T18:08:25.986 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:25.986 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:25.987 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:25.987 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:25.987 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:25.987 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:25.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-18T18:08:25.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-18T18:08:26.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-18T18:08:26.106 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:26.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:26.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-18T18:08:26.117 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:26.117 INFO:tasks.ceph:role: osd.5 2024-03-18T18:08:26.117 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:08:26.117 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T18:08:26.637 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:26.637 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:26.637 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:26.637 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2024-03-18T18:08:26.637 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:26.637 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:26.638 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:26.638 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:26.638 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:26.638 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:26.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-18T18:08:26.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-18T18:08:26.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-18T18:08:26.687 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:26.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:26.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-18T18:08:26.747 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:26.747 INFO:tasks.ceph:role: osd.6 2024-03-18T18:08:26.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:08:26.747 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T18:08:27.217 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2024-03-18T18:08:27.217 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:27.218 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:27.218 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:27.218 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:27.219 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-18T18:08:27.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-18T18:08:27.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-18T18:08:27.290 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:27.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:27.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-18T18:08:27.302 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T18:08:27.302 INFO:tasks.ceph:role: osd.7 2024-03-18T18:08:27.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:08:27.302 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T18:08:27.833 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T18:08:27.833 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T18:08:27.833 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T18:08:27.833 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2024-03-18T18:08:27.833 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T18:08:27.834 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-18T18:08:27.834 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T18:08:27.834 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T18:08:27.834 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T18:08:27.834 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T18:08:27.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-18T18:08:27.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-18T18:08:27.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-18T18:08:27.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:08:27.917 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-03-18T18:08:27.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:27.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:27.989+0000 7f69a1e16700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-18T18:08:27.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:27.989+0000 7f69a1e16700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-18T18:08:27.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:27.989+0000 7f69a1e16700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T18:08:27.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:27.989+0000 7f69a1e16700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T18:08:27.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:27.989+0000 7f69a1e16700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T18:08:27.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:27.993+0000 7f69a1e16700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-18T18:08:31.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-18T18:08:31.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:31.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:31.373+0000 7fee04dd3700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-18T18:08:31.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:31.373+0000 7fee04dd3700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-18T18:08:31.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:31.373+0000 7fee04dd3700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T18:08:31.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:31.373+0000 7fee04dd3700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T18:08:31.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:31.373+0000 7fee04dd3700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T18:08:31.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:31.373+0000 7fee04dd3700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-18T18:08:34.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-18T18:08:34.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:34.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:34.453+0000 7fe48f1b9700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-18T18:08:34.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:34.453+0000 7fe48f1b9700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-18T18:08:34.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:34.453+0000 7fe48f1b9700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T18:08:34.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:34.453+0000 7fe48f1b9700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T18:08:34.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:34.453+0000 7fe48f1b9700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T18:08:34.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:34.453+0000 7fe48f1b9700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-18T18:08:37.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-18T18:08:37.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:37.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:37.537+0000 7f198aaad700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-18T18:08:37.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:37.541+0000 7f198aaad700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-18T18:08:37.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:37.541+0000 7f198aaad700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T18:08:37.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:37.541+0000 7f198aaad700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T18:08:37.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:37.541+0000 7f198aaad700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T18:08:37.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:37.541+0000 7f198aaad700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-18T18:08:40.570 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-18T18:08:40.587 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-18T18:08:40.587 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.587 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-18T18:08:40.604 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.604 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-18T18:08:40.613 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.614 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-18T18:08:40.624 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.624 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-18T18:08:40.681 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.682 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-18T18:08:40.691 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.691 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-18T18:08:40.705 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:40.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-18T18:08:40.721 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:40.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-18T18:08:40.730 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:40.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-18T18:08:40.741 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:40.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-18T18:08:40.753 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:40.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-18T18:08:40.810 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:40.810 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-18T18:08:40.820 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:40.820 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-18T18:08:40.827 INFO:tasks.ceph:Adding keys to all mons... 2024-03-18T18:08:40.827 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T18:08:40.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T18:08:40.840 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-03-18T18:08:40.840 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAMg/hlFbjEDBAANV2WXEj0IuIuPg24AwmWWQ== 2024-03-18T18:08:40.840 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAMg/hlxi6rExAA28a7o0iT4m6I8ri9SYJ5XQ== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQANg/hlTenYAxAA11qzY4nArRaZa1B6ynL2SA== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAQg/hlqf3/CBAAEeVbEpDCL+4xKnIqN1S7sA== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQATg/hl2Q/YEBAAQvq5YRACr76vWKBdbx3LIw== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAWg/hlNIJ3FRAA0hy4Mky3TJJVwT6IiOhupA== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAMg/hlTXHXDxAApz4kzVVtNQElO0/uJaQMMg== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAMg/hled58FxAAdWHcaSxwPJAgvmE1ybk2sQ== 2024-03-18T18:08:40.841 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAbg/hlcScsOxAAYUNb3NbOIPOOtmV69BKPBw== 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAfg/hl+saLFhAAw7SiRhVhjBrzPXQI8oN0aw== 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAig/hloYNUGxAAvRLl+HsFVYCZazQqDHieIQ== 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAlg/hl6X1zIBAAC0FOMWIniv41wwSOhluz0g== 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-03-18T18:08:40.842 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQAMg/hlHgHsGhAA1Gsij121nGp90lgnTBe3hw== 2024-03-18T18:08:40.843 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2024-03-18T18:08:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAMg/hlFbjEDBAANV2WXEj0IuIuPg24AwmWWQ== 2024-03-18T18:08:40.843 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2024-03-18T18:08:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAMg/hlxi6rExAA28a7o0iT4m6I8ri9SYJ5XQ== 2024-03-18T18:08:40.843 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-03-18T18:08:40.843 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQANg/hlTenYAxAA11qzY4nArRaZa1B6ynL2SA== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAQg/hlqf3/CBAAEeVbEpDCL+4xKnIqN1S7sA== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQATg/hl2Q/YEBAAQvq5YRACr76vWKBdbx3LIw== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAWg/hlNIJ3FRAA0hy4Mky3TJJVwT6IiOhupA== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAMg/hlTXHXDxAApz4kzVVtNQElO0/uJaQMMg== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAMg/hled58FxAAdWHcaSxwPJAgvmE1ybk2sQ== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAbg/hlcScsOxAAYUNb3NbOIPOOtmV69BKPBw== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAfg/hl+saLFhAAw7SiRhVhjBrzPXQI8oN0aw== 2024-03-18T18:08:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2024-03-18T18:08:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAig/hloYNUGxAAvRLl+HsFVYCZazQqDHieIQ== 2024-03-18T18:08:40.845 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2024-03-18T18:08:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAlg/hl6X1zIBAAC0FOMWIniv41wwSOhluz0g== 2024-03-18T18:08:40.845 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2024-03-18T18:08:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAMg/hlHgHsGhAA1Gsij121nGp90lgnTBe3hw== 2024-03-18T18:08:40.846 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T18:08:40.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T18:08:40.936 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T18:08:40.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T18:08:40.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:40.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.039 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.064 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:08:41.131 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:08:41.136 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.188 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.237 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T18:08:41.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T18:08:41.332 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T18:08:41.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T18:08:41.387 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.490 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.539 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T18:08:41.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T18:08:41.632 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T18:08:41.685 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-18T18:08:41.685 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-18T18:08:41.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T18:08:41.792 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-18T18:08:41.807 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-18T18:08:41.823 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T18:08:41.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-18T18:08:41.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-18T18:08:42.003 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T18:08:42.113 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-18T18:08:42.128 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:42.131 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T18:08:42.135 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-18T18:08:42.136 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-18T18:08:42.136 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-18T18:08:42.179 INFO:tasks.ceph.mon.a:Started 2024-03-18T18:08:42.180 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-18T18:08:42.180 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-18T18:08:42.182 INFO:tasks.ceph.mon.b:Started 2024-03-18T18:08:42.182 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-18T18:08:42.182 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-18T18:08:42.184 INFO:tasks.ceph.mon.c:Started 2024-03-18T18:08:42.185 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-18T18:08:42.185 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-18T18:08:42.185 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-18T18:08:42.187 INFO:tasks.ceph.mgr.y:Started 2024-03-18T18:08:42.187 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-18T18:08:42.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-18T18:08:42.190 INFO:tasks.ceph.mgr.x:Started 2024-03-18T18:08:42.190 INFO:tasks.ceph:Setting crush tunables to default 2024-03-18T18:08:42.190 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-03-18T18:08:42.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4dc9df700 1 Processor -- start 2024-03-18T18:08:42.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4dc9df700 1 -- start start 2024-03-18T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4dc9df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4dc9df700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80adb10 con 0x7fa4d814a410 2024-03-18T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4dc9df700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80af000 con 0x7fa4d80b3f80 2024-03-18T18:08:42.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4dc9df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80aecd0 con 0x7fa4d80b4f00 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d759e700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa4d814a410 0x7fa4d81512b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:44268/0 (socket says 172.21.15.94:44268) 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d759e700 1 -- 172.21.15.94:0/660826574 learned_addr learned my addr 172.21.15.94:0/660826574 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:42.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.301+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T18:08:42.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.505+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:42.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.505+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:42.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.505+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:42.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.505+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:42.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.505+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-18T18:08:42.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.909+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:42.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.909+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:42.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.909+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:42.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.909+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:42.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:42.909+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-18T18:08:43.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:43.713+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:43.713+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:43.713+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:43.713+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:43.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:43.713+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 msgr2=0x7fa4d80b2500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4d80b4f00 0x7fa4d80b2500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 >> v1:172.21.15.151:6789/0 conn(0x7fa4d80b3f80 legacy=0x7fa4d8149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 >> v1:172.21.15.94:6789/0 conn(0x7fa4d814a410 legacy=0x7fa4d81512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d80aecd0 con 0x7fa4c40062e0 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c4008e20 con 0x7fa4c4003790 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T18:08:45.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:45.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:45.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:45.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:45.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:45.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T18:08:45.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.305+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:45.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.509+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T18:08:45.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:45.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:45.913+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-18T18:08:46.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d659c700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d659c700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T18:08:46.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:46.717+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-18T18:08:47.589 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:47.585+0000 7f01c5a542c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T18:08:48.229 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.225+0000 7f01c5a542c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T18:08:48.288 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.285+0000 7f01c5a542c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T18:08:48.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 msgr2=0x7fa4c4005bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4003790 0x7fa4c4005bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 msgr2=0x7fa4c4008760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.94:3300/0 conn(0x7fa4c40062e0 0x7fa4c4008760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 -- 172.21.15.94:0/660826574 reap_dead start 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4003be0 0x7fa4c4006750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4008870 0x7fa4c400d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80b52e0 con 0x7fa4c4006c90 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d80aecd0 con 0x7fa4c4008870 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d4d99700 1 -- 172.21.15.94:0/660826574 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4008e20 con 0x7fa4c4003be0 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4003be0 0x7fa4c4006750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 --2- 172.21.15.94:0/660826574 >> v2:172.21.15.151:3300/0 conn(0x7fa4c4008870 0x7fa4c400d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4003be0 msgr2=0x7fa4c4006750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:48.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4003be0 0x7fa4c4006750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 -- 172.21.15.94:0/660826574 >> v1:172.21.15.151:6789/0 conn(0x7fa4c4006c90 legacy=0x7fa4c4007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 -- 172.21.15.94:0/660826574 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c400ea10 con 0x7fa4c4008870 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d6d9d700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4003be0 0x7fa4c4006750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.301+0000 7fa4d759e700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4008870 0x7fa4c400d270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8072360 tx=0x7fa4d0001f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4804ddfb4f29708 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4d5d9b700 1 -- 172.21.15.94:0/660826574 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00074e0 con 0x7fa4c4008870 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4d5d9b700 1 -- 172.21.15.94:0/660826574 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0007640 con 0x7fa4c4008870 2024-03-18T18:08:48.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4d5d9b700 1 -- 172.21.15.94:0/660826574 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00079b0 con 0x7fa4c4008870 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 -- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4008870 msgr2=0x7fa4c400d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4008870 0x7fa4c400d270 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8072360 tx=0x7fa4d0001f00 comp rx=0 tx=0).stop 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 -- 172.21.15.94:0/660826574 shutdown_connections 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4008870 0x7fa4c400d270 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/660826574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4003be0 0x7fa4c4006750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 -- 172.21.15.94:0/660826574 >> 172.21.15.94:0/660826574 conn(0x7fa4d806a330 msgr2=0x7fa4d806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 -- 172.21.15.94:0/660826574 shutdown_connections 2024-03-18T18:08:48.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.305+0000 7fa4dc9df700 1 -- 172.21.15.94:0/660826574 wait complete. 2024-03-18T18:08:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 Processor -- start 2024-03-18T18:08:48.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 -- start start 2024-03-18T18:08:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4c4003be0 0x7fa4d81df130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4006c90 0x7fa4d8140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4008870 0x7fa4d8140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81df670 con 0x7fa4c4003be0 2024-03-18T18:08:48.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d813dc10 con 0x7fa4c4006c90 2024-03-18T18:08:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4dc9df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81df8a0 con 0x7fa4c4008870 2024-03-18T18:08:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d6d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4c4003be0 0x7fa4d81df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d6d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4c4003be0 0x7fa4d81df130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58146/0 (socket says 172.21.15.94:58146) 2024-03-18T18:08:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4006c90 0x7fa4d8140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d6d9d700 1 -- 172.21.15.94:0/2518985313 learned_addr learned my addr 172.21.15.94:0/2518985313 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:08:48.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d759e700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4008870 0x7fa4d8140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d759e700 1 -- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4006c90 msgr2=0x7fa4d8140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d759e700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4006c90 0x7fa4d8140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d759e700 1 -- 172.21.15.94:0/2518985313 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4c4003be0 msgr2=0x7fa4d81df130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d759e700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4c4003be0 0x7fa4d81df130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.309+0000 7fa4d759e700 1 -- 172.21.15.94:0/2518985313 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc00e040 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4d759e700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4008870 0x7fa4d8140690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80b36a0 tx=0x7fa4d00014a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0001bc0 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d001d420 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d80adb10 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d001d810 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d8070fa0 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa4d001d970 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa4d0026760 con 0x7fa4c4008870 2024-03-18T18:08:48.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.313+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8074440 con 0x7fa4c4008870 2024-03-18T18:08:48.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.317+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fa4d0021020 con 0x7fa4c4008870 2024-03-18T18:08:48.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.389+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa4d8149c30 con 0x7fa4c4008870 2024-03-18T18:08:48.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4bf7fe700 1 -- 172.21.15.94:0/2518985313 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa4d0017070 con 0x7fa4c4008870 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4008870 msgr2=0x7fa4d8140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4008870 0x7fa4d8140690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80b36a0 tx=0x7fa4d00014a0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 shutdown_connections 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c4008870 0x7fa4d8140690 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c4006c90 0x7fa4d8140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 --2- 172.21.15.94:0/2518985313 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4c4003be0 0x7fa4d81df130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 >> 172.21.15.94:0/2518985313 conn(0x7fa4d806a330 msgr2=0x7fa4d80b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:48.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 shutdown_connections 2024-03-18T18:08:48.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:48.397+0000 7fa4dc9df700 1 -- 172.21.15.94:0/2518985313 wait complete. 2024-03-18T18:08:48.402 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-03-18T18:08:48.414 INFO:tasks.ceph:check_enable_crimson: False 2024-03-18T18:08:48.414 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-18T18:08:48.414 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:48.414 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-18T18:08:48.424 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:48.424 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-18T18:08:48.438 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:48.438 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-18T18:08:48.450 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:08:48.450 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-18T18:08:48.457 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:48.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-18T18:08:48.465 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.461+0000 7f01c5a542c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T18:08:48.474 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:48.474 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-18T18:08:48.521 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:48.516+0000 7f1a08ea62c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T18:08:48.530 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:48.530 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-18T18:08:48.538 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-18T18:08:48.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-18T18:08:48.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 4c6d875d-363b-48ff-855e-ea3310bb4b9b 0 2024-03-18T18:08:48.675 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.673+0000 7f01c5a542c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T18:08:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5dab462700 1 Processor -- start 2024-03-18T18:08:48.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5dab462700 1 -- start start 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5dab462700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5da40b6040 0x7f5da41469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5dab462700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40b6420 con 0x7f5da40b5320 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5dab462700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da40712e0 con 0x7f5da40afcb0 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5dab462700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da40722c0 con 0x7f5da40b6040 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5da89fd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5da40afcb0 0x7f5da413d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53832/0 (socket says 172.21.15.151:53832) 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5da89fd700 1 -- 172.21.15.151:0/2478433858 learned_addr learned my addr 172.21.15.151:0/2478433858 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.696+0000 7f5da91fe700 1 --2- 172.21.15.151:0/2478433858 >> v2:172.21.15.94:3300/0 conn(0x7f5da40b6040 0x7f5da41469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017652291 0 0) 0x7f5da40712e0 con 0x7f5da40afcb0 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d900035d0 con 0x7f5da40afcb0 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529884184 0 0) 0x7f5da40b6420 con 0x7f5da40b5320 2024-03-18T18:08:48.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da40712e0 con 0x7f5da40b5320 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349629952 0 0) 0x7f5d900035d0 con 0x7f5da40afcb0 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 >> v2:172.21.15.94:3300/0 conn(0x7f5da40b6040 msgr2=0x7f5da41469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 --2- 172.21.15.151:0/2478433858 >> v2:172.21.15.94:3300/0 conn(0x7f5da40b6040 0x7f5da41469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 >> v1:172.21.15.94:6789/0 conn(0x7f5da40b5320 legacy=0x7f5da414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da406f9b0 con 0x7f5da40afcb0 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f5d94001670 con 0x7f5da40afcb0 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 >> v1:172.21.15.151:6789/0 conn(0x7f5da40afcb0 legacy=0x7f5da413d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5d90003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d90004870 0x7f5d90004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d90005230 0x7f5d9000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40722c0 con 0x7f5d90004870 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9000c0b0 con 0x7f5d90005230 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9000c270 con 0x7f5d90003bb0 2024-03-18T18:08:48.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5d90003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da99ff700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d90005230 0x7f5d9000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 -- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d90005230 msgr2=0x7f5d9000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d90005230 0x7f5d9000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da89fd700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d90004870 0x7f5d90004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 -- 172.21.15.151:0/2478433858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d90004870 msgr2=0x7f5d90004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d90004870 0x7f5d90004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 -- 172.21.15.151:0/2478433858 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d900035d0 con 0x7f5d90003bb0 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da99ff700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d90005230 0x7f5d9000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da89fd700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d90004870 0x7f5d90004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da99ff700 1 -- 172.21.15.151:0/2478433858 reap_dead start 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5da91fe700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5d90003fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009b70 tx=0x7f5d900058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6d64a9b2237c8c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:48.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000e6c0 con 0x7f5d90003bb0 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da000e820 con 0x7f5d90003bb0 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5d9bfff700 1 -- 172.21.15.151:0/2478433858 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000eb90 con 0x7f5d90003bb0 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 -- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 msgr2=0x7f5d90003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5d90003fb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009b70 tx=0x7f5d900058a0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 -- 172.21.15.151:0/2478433858 shutdown_connections 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 --2- 172.21.15.151:0/2478433858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5d90003fb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 -- 172.21.15.151:0/2478433858 >> 172.21.15.151:0/2478433858 conn(0x7f5da406ce60 msgr2=0x7f5da406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 -- 172.21.15.151:0/2478433858 shutdown_connections 2024-03-18T18:08:48.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.700+0000 7f5dab462700 1 -- 172.21.15.151:0/2478433858 wait complete. 2024-03-18T18:08:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 Processor -- start 2024-03-18T18:08:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- start start 2024-03-18T18:08:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5da40b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40b8780 0x7f5da4145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da406a150 0x7f5da406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4144a30 con 0x7f5da40b8780 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da41463c0 con 0x7f5da406a150 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40b7710 con 0x7f5d90003bb0 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da99ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da406a150 0x7f5da406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5da40b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da99ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da406a150 0x7f5da406a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39752/0 (socket says 172.21.15.151:39752) 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da99ff700 1 -- 172.21.15.151:0/1664310330 learned_addr learned my addr 172.21.15.151:0/1664310330 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da89fd700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40b8780 0x7f5da4145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 -- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da406a150 msgr2=0x7f5da406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da406a150 0x7f5da406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 -- 172.21.15.151:0/1664310330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40b8780 msgr2=0x7f5da4145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40b8780 0x7f5da4145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 -- 172.21.15.151:0/1664310330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4070330 con 0x7f5d90003bb0 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5da91fe700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5da40b2850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009b40 tx=0x7f5da00047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:48.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000e6c0 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da00038e0 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da40b7ed0 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0003c90 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da40b7050 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5da0013770 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5da001c7e0 con 0x7f5d90003bb0 2024-03-18T18:08:48.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.704+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da4067100 con 0x7f5d90003bb0 2024-03-18T18:08:48.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.708+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f5da002a070 con 0x7f5d90003bb0 2024-03-18T18:08:48.726 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.725+0000 7f01c5a542c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T18:08:48.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.784+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c6d875d-363b-48ff-855e-ea3310bb4b9b", "id": 0} v 0) v1 -- 0x7f5da413d790 con 0x7f5d90003bb0 2024-03-18T18:08:48.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5d99ffb700 1 -- 172.21.15.151:0/1664310330 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c6d875d-363b-48ff-855e-ea3310bb4b9b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5da0017070 con 0x7f5d90003bb0 2024-03-18T18:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 msgr2=0x7f5da40b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5da40b2850 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009b40 tx=0x7f5da00047e0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 shutdown_connections 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da406a150 0x7f5da406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40b8780 0x7f5da4145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 --2- 172.21.15.151:0/1664310330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d90003bb0 0x7f5da40b2850 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 >> 172.21.15.151:0/1664310330 conn(0x7f5da406ce60 msgr2=0x7f5da4143670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.792+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 shutdown_connections 2024-03-18T18:08:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.796+0000 7f5dab462700 1 -- 172.21.15.151:0/1664310330 wait complete. 2024-03-18T18:08:48.811 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new e5f2517d-ba21-455c-8407-754f0bb11499 1 2024-03-18T18:08:48.910 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.905+0000 7f01c5a542c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T18:08:48.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 Processor -- start 2024-03-18T18:08:48.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 -- start start 2024-03-18T18:08:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f325013e940 0x7f3250148490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32500b2e30 0x7f325006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3250072c10 con 0x7f3250073240 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32501489d0 con 0x7f32500b2e30 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f3255b19700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3250147a40 con 0x7f325013e940 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f324ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32500b2e30 0x7f325006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f324effd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f325013e940 0x7f3250148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f324f7fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3250073240 0x7f325013e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53838/0 (socket says 172.21.15.151:53838) 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.924+0000 7f324f7fe700 1 -- 172.21.15.151:0/3766018372 learned_addr learned my addr 172.21.15.151:0/3766018372 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324ffff700 1 -- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f325013e940 msgr2=0x7f3250148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324ffff700 1 --2- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f325013e940 0x7f3250148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324ffff700 1 -- 172.21.15.151:0/3766018372 >> v1:172.21.15.151:6789/0 conn(0x7f3250073240 legacy=0x7f325013e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324e7fc700 1 -- 172.21.15.151:0/3766018372 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365254676 0 0) 0x7f3250072c10 con 0x7f3250073240 2024-03-18T18:08:48.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324ffff700 1 -- 172.21.15.151:0/3766018372 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325006f790 con 0x7f32500b2e30 2024-03-18T18:08:48.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324effd700 1 --2- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f325013e940 0x7f3250148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:48.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324ffff700 1 --2- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32500b2e30 0x7f325006f250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3248009dc0 tx=0x7f324800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff72a0ae7f5f961a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:48.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324e7fc700 1 -- 172.21.15.151:0/3766018372 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800e070 con 0x7f32500b2e30 2024-03-18T18:08:48.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324e7fc700 1 -- 172.21.15.151:0/3766018372 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800bae0 con 0x7f32500b2e30 2024-03-18T18:08:48.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f324e7fc700 1 -- 172.21.15.151:0/3766018372 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800be90 con 0x7f32500b2e30 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 -- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32500b2e30 msgr2=0x7f325006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 --2- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32500b2e30 0x7f325006f250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3248009dc0 tx=0x7f324800b330 comp rx=0 tx=0).stop 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 -- 172.21.15.151:0/3766018372 shutdown_connections 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 --2- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32500b2e30 0x7f325006f250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 --2- 172.21.15.151:0/3766018372 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f325013e940 0x7f3250148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 -- 172.21.15.151:0/3766018372 >> 172.21.15.151:0/3766018372 conn(0x7f32500b8430 msgr2=0x7f32500b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 -- 172.21.15.151:0/3766018372 shutdown_connections 2024-03-18T18:08:48.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 -- 172.21.15.151:0/3766018372 wait complete. 2024-03-18T18:08:48.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 Processor -- start 2024-03-18T18:08:48.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.928+0000 7f3255b19700 1 -- start start 2024-03-18T18:08:48.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 0x7f3250144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32500b2e30 0x7f32501dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f325013e940 0x7f325013a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500aed00 con 0x7f325013e940 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500aefe0 con 0x7f3250073240 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32500ac850 con 0x7f32500b2e30 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 0x7f3250144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 0x7f3250144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39780/0 (socket says 172.21.15.151:39780) 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 -- 172.21.15.151:0/168013210 learned_addr learned my addr 172.21.15.151:0/168013210 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324effd700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32500b2e30 0x7f32501dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324ffff700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f325013e940 0x7f325013a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 -- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32500b2e30 msgr2=0x7f32501dedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32500b2e30 0x7f32501dedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 -- 172.21.15.151:0/168013210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f325013e940 msgr2=0x7f325013a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:48.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f325013e940 0x7f325013a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 -- 172.21.15.151:0/168013210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32440094b0 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324ffff700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f325013e940 0x7f325013a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f324f7fe700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 0x7f3250144820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f324000c580 tx=0x7f324000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240004ca0 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240004e20 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3248009a70 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240007310 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3250146570 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f324001d3f0 con 0x7f3250073240 2024-03-18T18:08:48.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3240013770 con 0x7f3250073240 2024-03-18T18:08:48.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.932+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325006feb0 con 0x7f3250073240 2024-03-18T18:08:48.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:48.936+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f32400139e0 con 0x7f3250073240 2024-03-18T18:08:48.975 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:48.973+0000 7f01c5a542c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T18:08:49.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.012+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e5f2517d-ba21-455c-8407-754f0bb11499", "id": 1} v 0) v1 -- 0x7f32500b4aa0 con 0x7f3250073240 2024-03-18T18:08:49.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3237fff700 1 -- 172.21.15.151:0/168013210 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5f2517d-ba21-455c-8407-754f0bb11499", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3240013cb0 con 0x7f3250073240 2024-03-18T18:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 msgr2=0x7f3250144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 0x7f3250144820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f324000c580 tx=0x7f324000c890 comp rx=0 tx=0).stop 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 shutdown_connections 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f325013e940 0x7f325013a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32500b2e30 0x7f32501dedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 --2- 172.21.15.151:0/168013210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3250073240 0x7f3250144820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 >> 172.21.15.151:0/168013210 conn(0x7f32500b8430 msgr2=0x7f32500b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 shutdown_connections 2024-03-18T18:08:49.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.020+0000 7f3255b19700 1 -- 172.21.15.151:0/168013210 wait complete. 2024-03-18T18:08:49.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new e2df52ba-c9a5-4aca-b560-47db406b5a72 2 2024-03-18T18:08:49.039 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:49.037+0000 7f01c5a542c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T18:08:49.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 Processor -- start 2024-03-18T18:08:49.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 -- start start 2024-03-18T18:08:49.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe934073240 0x7fe934148230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9340b2c70 0x7fe93406ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe934147da0 con 0x7fe93413e0b0 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340707a0 con 0x7fe9340b2c70 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe93a3d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe934070530 con 0x7fe934073240 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe9393d4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe934073240 0x7fe934148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe939bd5700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe93413e0b0 0x7fe9341442e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53850/0 (socket says 172.21.15.151:53850) 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe939bd5700 1 -- 172.21.15.151:0/4075784953 learned_addr learned my addr 172.21.15.151:0/4075784953 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe938bd3700 1 --2- 172.21.15.151:0/4075784953 >> v2:172.21.15.94:3300/0 conn(0x7fe9340b2c70 0x7fe93406ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe927fff700 1 -- 172.21.15.151:0/4075784953 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451453758 0 0) 0x7fe934147da0 con 0x7fe93413e0b0 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe9393d4700 1 -- 172.21.15.151:0/4075784953 >> v2:172.21.15.94:3300/0 conn(0x7fe9340b2c70 msgr2=0x7fe93406ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe9393d4700 1 --2- 172.21.15.151:0/4075784953 >> v2:172.21.15.94:3300/0 conn(0x7fe9340b2c70 0x7fe93406ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe9393d4700 1 -- 172.21.15.151:0/4075784953 >> v1:172.21.15.151:6789/0 conn(0x7fe93413e0b0 legacy=0x7fe9341442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe9393d4700 1 -- 172.21.15.151:0/4075784953 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934073620 con 0x7fe934073240 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe938bd3700 1 --2- 172.21.15.151:0/4075784953 >> v2:172.21.15.94:3300/0 conn(0x7fe9340b2c70 0x7fe93406ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:08:49.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.144+0000 7fe9393d4700 1 --2- 172.21.15.151:0/4075784953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe934073240 0x7fe934148230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe930009850 tx=0x7fe930009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc20f11bfcea7861 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe927fff700 1 -- 172.21.15.151:0/4075784953 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930011830 con 0x7fe934073240 2024-03-18T18:08:49.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe927fff700 1 -- 172.21.15.151:0/4075784953 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930011990 con 0x7fe934073240 2024-03-18T18:08:49.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe927fff700 1 -- 172.21.15.151:0/4075784953 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930011d20 con 0x7fe934073240 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- 172.21.15.151:0/4075784953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe934073240 msgr2=0x7fe934148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/4075784953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe934073240 0x7fe934148230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe930009850 tx=0x7fe930009b60 comp rx=0 tx=0).stop 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- 172.21.15.151:0/4075784953 shutdown_connections 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/4075784953 >> v2:172.21.15.94:3300/0 conn(0x7fe9340b2c70 0x7fe93406ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/4075784953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe934073240 0x7fe934148230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- 172.21.15.151:0/4075784953 >> 172.21.15.151:0/4075784953 conn(0x7fe9340b4d70 msgr2=0x7fe9340b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- 172.21.15.151:0/4075784953 shutdown_connections 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- 172.21.15.151:0/4075784953 wait complete. 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 Processor -- start 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- start start 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe934073240 0x7fe93413a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 0x7fe93413a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe93413e0b0 0x7fe9341db5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934139d40 con 0x7fe934073240 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93413abc0 con 0x7fe9340b2c70 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe93a3d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe934139710 con 0x7fe93413e0b0 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe938bd3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 0x7fe93413a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe939bd5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe93413e0b0 0x7fe9341db5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe938bd3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 0x7fe93413a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39782/0 (socket says 172.21.15.151:39782) 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe938bd3700 1 -- 172.21.15.151:0/3311354279 learned_addr learned my addr 172.21.15.151:0/3311354279 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.148+0000 7fe9393d4700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe934073240 0x7fe93413a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe939bd5700 1 -- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 msgr2=0x7fe93413a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe939bd5700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 0x7fe93413a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe939bd5700 1 -- 172.21.15.151:0/3311354279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe934073240 msgr2=0x7fe93413a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe939bd5700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe934073240 0x7fe93413a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe939bd5700 1 -- 172.21.15.151:0/3311354279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300094b0 con 0x7fe93413e0b0 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe938bd3700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 0x7fe93413a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:49.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe939bd5700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe93413e0b0 0x7fe9341db5d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00cbe0 tx=0x7fe92c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00aa40 con 0x7fe93413e0b0 2024-03-18T18:08:49.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c00abc0 con 0x7fe93413e0b0 2024-03-18T18:08:49.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe934139960 con 0x7fe93413e0b0 2024-03-18T18:08:49.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0070d0 con 0x7fe93413e0b0 2024-03-18T18:08:49.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9340b1db0 con 0x7fe93413e0b0 2024-03-18T18:08:49.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe92c007530 con 0x7fe93413e0b0 2024-03-18T18:08:49.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe92c01d440 con 0x7fe93413e0b0 2024-03-18T18:08:49.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.152+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe934074440 con 0x7fe93413e0b0 2024-03-18T18:08:49.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.156+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fe92c018070 con 0x7fe93413e0b0 2024-03-18T18:08:49.185 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:49.180+0000 7f1a08ea62c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T18:08:49.256 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:49.252+0000 7f1a08ea62c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T18:08:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.256+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2df52ba-c9a5-4aca-b560-47db406b5a72", "id": 2} v 0) v1 -- 0x7fe9340720f0 con 0x7fe93413e0b0 2024-03-18T18:08:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.260+0000 7fe925ffb700 1 -- 172.21.15.151:0/3311354279 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2df52ba-c9a5-4aca-b560-47db406b5a72", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe92c0077e0 con 0x7fe93413e0b0 2024-03-18T18:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe93413e0b0 msgr2=0x7fe9341db5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe93413e0b0 0x7fe9341db5d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00cbe0 tx=0x7fe92c00cef0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 shutdown_connections 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe93413e0b0 0x7fe9341db5d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9340b2c70 0x7fe93413a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 --2- 172.21.15.151:0/3311354279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe934073240 0x7fe93413a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 >> 172.21.15.151:0/3311354279 conn(0x7fe9340b4d70 msgr2=0x7fe9340b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 shutdown_connections 2024-03-18T18:08:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.264+0000 7fe93a3d6700 1 -- 172.21.15.151:0/3311354279 wait complete. 2024-03-18T18:08:49.281 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 56440f46-def3-45e5-b91c-412d16724605 3 2024-03-18T18:08:49.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50073a6700 1 Processor -- start 2024-03-18T18:08:49.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50073a6700 1 -- start start 2024-03-18T18:08:49.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50073a6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50000b5b20 0x7f500006f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50073a6700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50000705f0 con 0x7f5000143d70 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50073a6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5000071f40 con 0x7f5000143910 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50073a6700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50000712e0 con 0x7f50000b5b20 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50063a4700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50000b5b20 0x7f500006f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f5006ba5700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5000143d70 0x7f5000146ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.151:49370/0 (socket says 172.21.15.151:49370) 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f5005ba3700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5000143910 0x7f50001467b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53852/0 (socket says 172.21.15.151:53852) 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f5006ba5700 1 -- 172.21.15.151:0/1268716490 learned_addr learned my addr 172.21.15.151:0/1268716490 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-18T18:08:49.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50063a4700 1 -- 172.21.15.151:0/1268716490 >> v1:172.21.15.151:6789/0 conn(0x7f5000143910 legacy=0x7f50001467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50063a4700 1 -- 172.21.15.151:0/1268716490 >> v1:172.21.15.94:6789/0 conn(0x7f5000143d70 legacy=0x7f5000146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50063a4700 1 -- 172.21.15.151:0/1268716490 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500013d9e0 con 0x7f50000b5b20 2024-03-18T18:08:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50063a4700 1 --2- 172.21.15.151:0/1268716490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f500006f6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009850 tx=0x7f4ffc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f46e29f70811cf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50053a2700 1 -- 172.21.15.151:0/1268716490 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc004230 con 0x7f50000b5b20 2024-03-18T18:08:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50053a2700 1 -- 172.21.15.151:0/1268716490 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc004390 con 0x7f50000b5b20 2024-03-18T18:08:49.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.388+0000 7f50053a2700 1 -- 172.21.15.151:0/1268716490 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0036c0 con 0x7f50000b5b20 2024-03-18T18:08:49.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- 172.21.15.151:0/1268716490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 msgr2=0x7f500006f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 --2- 172.21.15.151:0/1268716490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f500006f6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009850 tx=0x7f4ffc009b60 comp rx=0 tx=0).stop 2024-03-18T18:08:49.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- 172.21.15.151:0/1268716490 shutdown_connections 2024-03-18T18:08:49.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 --2- 172.21.15.151:0/1268716490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f500006f6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- 172.21.15.151:0/1268716490 >> 172.21.15.151:0/1268716490 conn(0x7f500006ba30 msgr2=0x7f500006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- 172.21.15.151:0/1268716490 shutdown_connections 2024-03-18T18:08:49.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- 172.21.15.151:0/1268716490 wait complete. 2024-03-18T18:08:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 Processor -- start 2024-03-18T18:08:49.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- start start 2024-03-18T18:08:49.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f50001d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5000143910 0x7f50000abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5000143d70 0x7f50000aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000ad1b0 con 0x7f50000b5b20 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50000aa5c0 con 0x7f5000143d70 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50073a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50001d9080 con 0x7f5000143910 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5006ba5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5000143d70 0x7f50000aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5000143910 0x7f50000abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5006ba5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5000143d70 0x7f50000aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39784/0 (socket says 172.21.15.151:39784) 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5006ba5700 1 -- 172.21.15.151:0/955622353 learned_addr learned my addr 172.21.15.151:0/955622353 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f50063a4700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f50001d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 -- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5000143d70 msgr2=0x7f50000aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5000143d70 0x7f50000aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 -- 172.21.15.151:0/955622353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 msgr2=0x7f50001d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f50001d8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 -- 172.21.15.151:0/955622353 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0094b0 con 0x7f5000143910 2024-03-18T18:08:49.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.392+0000 7f5005ba3700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5000143910 0x7f50000abd50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c440 tx=0x7f4ff000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0005cd0 con 0x7f5000143910 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0005e30 con 0x7f5000143910 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50000ad3b0 con 0x7f5000143910 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00072f0 con 0x7f5000143910 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5000140a00 con 0x7f5000143910 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ff001c440 con 0x7f5000143910 2024-03-18T18:08:49.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.396+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4ff000ce10 con 0x7f5000143910 2024-03-18T18:08:49.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.400+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5000067290 con 0x7f5000143910 2024-03-18T18:08:49.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.400+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f4ff0017070 con 0x7f5000143910 2024-03-18T18:08:49.416 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:49.413+0000 7f01c5a542c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T18:08:49.434 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:49.428+0000 7f1a08ea62c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T18:08:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.476+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56440f46-def3-45e5-b91c-412d16724605", "id": 3} v 0) v1 -- 0x7f50000675e0 con 0x7f5000143910 2024-03-18T18:08:49.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f4ff6ffd700 1 -- 172.21.15.151:0/955622353 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56440f46-def3-45e5-b91c-412d16724605", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ff001cad0 con 0x7f5000143910 2024-03-18T18:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5000143910 msgr2=0x7f50000abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5000143910 0x7f50000abd50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c440 tx=0x7f4ff000c750 comp rx=0 tx=0).stop 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 shutdown_connections 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5000143d70 0x7f50000aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5000143910 0x7f50000abd50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 --2- 172.21.15.151:0/955622353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50000b5b20 0x7f50001d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 >> 172.21.15.151:0/955622353 conn(0x7f500006ba30 msgr2=0x7f50000b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 shutdown_connections 2024-03-18T18:08:49.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.484+0000 7f50073a6700 1 -- 172.21.15.151:0/955622353 wait complete. 2024-03-18T18:08:49.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4 4 2024-03-18T18:08:49.541 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:49.537+0000 7f01c5a542c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T18:08:49.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86f34e700 1 Processor -- start 2024-03-18T18:08:49.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86f34e700 1 -- start start 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86f34e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8680b8400 0x7ff8680b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86f34e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8680b34c0 con 0x7ff868146ba0 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86f34e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8680bcb10 con 0x7ff8680bc730 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86f34e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680b5f00 con 0x7ff8680b8400 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86db4b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8680b8400 0x7ff8680b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86e34c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff8680bc730 0x7ff868146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53860/0 (socket says 172.21.15.151:53860) 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.608+0000 7ff86e34c700 1 -- 172.21.15.151:0/3644141788 learned_addr learned my addr 172.21.15.151:0/3644141788 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86db4b700 1 -- 172.21.15.151:0/3644141788 >> v1:172.21.15.151:6789/0 conn(0x7ff8680bc730 legacy=0x7ff868146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86db4b700 1 -- 172.21.15.151:0/3644141788 >> v1:172.21.15.94:6789/0 conn(0x7ff868146ba0 legacy=0x7ff868140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86db4b700 1 -- 172.21.15.151:0/3644141788 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680b3710 con 0x7ff8680b8400 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86db4b700 1 --2- 172.21.15.151:0/3644141788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680b8400 0x7ff8680b4ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff858009850 tx=0x7ff858009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493d73b41df9dfc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86d34a700 1 -- 172.21.15.151:0/3644141788 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011830 con 0x7ff8680b8400 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86d34a700 1 -- 172.21.15.151:0/3644141788 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858011990 con 0x7ff8680b8400 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86d34a700 1 -- 172.21.15.151:0/3644141788 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011d20 con 0x7ff8680b8400 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 -- 172.21.15.151:0/3644141788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680b8400 msgr2=0x7ff8680b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 --2- 172.21.15.151:0/3644141788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680b8400 0x7ff8680b4ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff858009850 tx=0x7ff858009b60 comp rx=0 tx=0).stop 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 -- 172.21.15.151:0/3644141788 shutdown_connections 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 --2- 172.21.15.151:0/3644141788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680b8400 0x7ff8680b4ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 -- 172.21.15.151:0/3644141788 >> 172.21.15.151:0/3644141788 conn(0x7ff868073600 msgr2=0x7ff8680bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 -- 172.21.15.151:0/3644141788 shutdown_connections 2024-03-18T18:08:49.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 -- 172.21.15.151:0/3644141788 wait complete. 2024-03-18T18:08:49.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 Processor -- start 2024-03-18T18:08:49.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.612+0000 7ff86f34e700 1 -- start start 2024-03-18T18:08:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680b8400 0x7ff8681cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680bc730 0x7ff8681df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff868146ba0 0x7ff868139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681df8a0 con 0x7ff868146ba0 2024-03-18T18:08:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681cf1a0 con 0x7ff8680bc730 2024-03-18T18:08:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681cf6f0 con 0x7ff8680b8400 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86e34c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680b8400 0x7ff8681cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680bc730 0x7ff8681df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86e34c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680b8400 0x7ff8681cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:53204/0 (socket says 172.21.15.151:53204) 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86e34c700 1 -- 172.21.15.151:0/3295240496 learned_addr learned my addr 172.21.15.151:0/3295240496 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86eb4d700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff868146ba0 0x7ff868139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 -- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680b8400 msgr2=0x7ff8681cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680b8400 0x7ff8681cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 -- 172.21.15.151:0/3295240496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff868146ba0 msgr2=0x7ff868139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff868146ba0 0x7ff868139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 -- 172.21.15.151:0/3295240496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580094b0 con 0x7ff8680bc730 2024-03-18T18:08:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86db4b700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680bc730 0x7ff8681df360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff86806a8d0 tx=0x7ff858004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580036c0 con 0x7ff8680bc730 2024-03-18T18:08:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858003820 con 0x7ff8680bc730 2024-03-18T18:08:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8681ce050 con 0x7ff8680bc730 2024-03-18T18:08:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858003bd0 con 0x7ff8680bc730 2024-03-18T18:08:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681cf410 con 0x7ff8680bc730 2024-03-18T18:08:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff85801a730 con 0x7ff8680bc730 2024-03-18T18:08:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff858021030 con 0x7ff8680bc730 2024-03-18T18:08:49.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.616+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff868067620 con 0x7ff8680bc730 2024-03-18T18:08:49.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.620+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ff858045b50 con 0x7ff8680bc730 2024-03-18T18:08:49.682 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:49.676+0000 7f1a08ea62c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T18:08:49.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.700+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4", "id": 4} v 0) v1 -- 0x7ff8681df9e0 con 0x7ff8680bc730 2024-03-18T18:08:49.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.708+0000 7ff85effd700 1 -- 172.21.15.151:0/3295240496 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff8681df9e0 con 0x7ff8680bc730 2024-03-18T18:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout:4 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680bc730 msgr2=0x7ff8681df360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680bc730 0x7ff8681df360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff86806a8d0 tx=0x7ff858004770 comp rx=0 tx=0).stop 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 shutdown_connections 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff868146ba0 0x7ff868139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8680bc730 0x7ff8681df360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 --2- 172.21.15.151:0/3295240496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8680b8400 0x7ff8681cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 >> 172.21.15.151:0/3295240496 conn(0x7ff868073600 msgr2=0x7ff868144400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 shutdown_connections 2024-03-18T18:08:49.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.712+0000 7ff86f34e700 1 -- 172.21.15.151:0/3295240496 wait complete. 2024-03-18T18:08:49.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 383029a0-1add-4835-b84c-d3a3294bea0a 5 2024-03-18T18:08:49.736 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:49.732+0000 7f1a08ea62c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T18:08:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 Processor -- start 2024-03-18T18:08:49.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- start start 2024-03-18T18:08:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e01442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6e013e6c0 0x7ff6e014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00b5400 con 0x7ff6e0144800 2024-03-18T18:08:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e0144c60 con 0x7ff6e013e6c0 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00b46d0 con 0x7ff6e0071c30 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6ddd9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff6e0144800 0x7ff6e013dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53874/0 (socket says 172.21.15.151:53874) 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6ded9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6e013e6c0 0x7ff6e014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6ddd9b700 1 -- 172.21.15.151:0/228262499 learned_addr learned my addr 172.21.15.151:0/228262499 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6de59c700 1 --2- 172.21.15.151:0/228262499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e01442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6de59c700 1 -- 172.21.15.151:0/228262499 >> v2:172.21.15.151:3300/0 conn(0x7ff6e013e6c0 msgr2=0x7ff6e014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6de59c700 1 --2- 172.21.15.151:0/228262499 >> v2:172.21.15.151:3300/0 conn(0x7ff6e013e6c0 0x7ff6e014ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6de59c700 1 -- 172.21.15.151:0/228262499 >> v1:172.21.15.151:6789/0 conn(0x7ff6e0144800 legacy=0x7ff6e013dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6dd59a700 1 -- 172.21.15.151:0/228262499 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597976821 0 0) 0x7ff6e00b5400 con 0x7ff6e0144800 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6de59c700 1 -- 172.21.15.151:0/228262499 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0072010 con 0x7ff6e0071c30 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6ded9d700 1 --2- 172.21.15.151:0/228262499 >> v2:172.21.15.151:3300/0 conn(0x7ff6e013e6c0 0x7ff6e014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6de59c700 1 --2- 172.21.15.151:0/228262499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e01442c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009850 tx=0x7ff6d0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bc116c1f47790da server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6dd59a700 1 -- 172.21.15.151:0/228262499 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011830 con 0x7ff6e0071c30 2024-03-18T18:08:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6dd59a700 1 -- 172.21.15.151:0/228262499 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0011990 con 0x7ff6e0071c30 2024-03-18T18:08:49.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6dd59a700 1 -- 172.21.15.151:0/228262499 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011d40 con 0x7ff6e0071c30 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- 172.21.15.151:0/228262499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 msgr2=0x7ff6e01442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 --2- 172.21.15.151:0/228262499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e01442c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009850 tx=0x7ff6d0009b60 comp rx=0 tx=0).stop 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- 172.21.15.151:0/228262499 shutdown_connections 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 --2- 172.21.15.151:0/228262499 >> v2:172.21.15.151:3300/0 conn(0x7ff6e013e6c0 0x7ff6e014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 --2- 172.21.15.151:0/228262499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e01442c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- 172.21.15.151:0/228262499 >> 172.21.15.151:0/228262499 conn(0x7ff6e00b5610 msgr2=0x7ff6e00b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- 172.21.15.151:0/228262499 shutdown_connections 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.836+0000 7ff6df59e700 1 -- 172.21.15.151:0/228262499 wait complete. 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 Processor -- start 2024-03-18T18:08:49.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 -- start start 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e00b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e013e6c0 0x7ff6e01dc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6e0144800 0x7ff6e0137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e013f1e0 con 0x7ff6e0144800 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0147e80 con 0x7ff6e013e6c0 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0147ba0 con 0x7ff6e0071c30 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e00b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e00b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:53224/0 (socket says 172.21.15.151:53224) 2024-03-18T18:08:49.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 -- 172.21.15.151:0/3319763249 learned_addr learned my addr 172.21.15.151:0/3319763249 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ddd9b700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e013e6c0 0x7ff6e01dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ded9d700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6e0144800 0x7ff6e0137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 -- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e013e6c0 msgr2=0x7ff6e01dc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e013e6c0 0x7ff6e01dc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 -- 172.21.15.151:0/3319763249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6e0144800 msgr2=0x7ff6e0137c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6e0144800 0x7ff6e0137c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 -- 172.21.15.151:0/3319763249 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8009a70 con 0x7ff6e0071c30 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ded9d700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6e0144800 0x7ff6e0137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6de59c700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e00b82d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0014040 tx=0x7ff6d0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0019a00 con 0x7ff6e0071c30 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d001e070 con 0x7ff6e0071c30 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0019da0 con 0x7ff6e0071c30 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d00094b0 con 0x7ff6e0071c30 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e013f3e0 con 0x7ff6e0071c30 2024-03-18T18:08:49.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6d002d750 con 0x7ff6e0071c30 2024-03-18T18:08:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.840+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff6d001a650 con 0x7ff6e0071c30 2024-03-18T18:08:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.844+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e0146080 con 0x7ff6e0071c30 2024-03-18T18:08:49.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.844+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ff6d0044b50 con 0x7ff6e0071c30 2024-03-18T18:08:49.902 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:49.901+0000 7f01c5a542c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T18:08:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.912+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "383029a0-1add-4835-b84c-d3a3294bea0a", "id": 5} v 0) v1 -- 0x7ff6e0074440 con 0x7ff6e0071c30 2024-03-18T18:08:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.920+0000 7ff6ceffd700 1 -- 172.21.15.151:0/3319763249 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "383029a0-1add-4835-b84c-d3a3294bea0a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6d0033070 con 0x7ff6e0071c30 2024-03-18T18:08:49.926 INFO:teuthology.orchestra.run.smithi151.stdout:5 2024-03-18T18:08:49.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 msgr2=0x7ff6e00b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:49.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e00b82d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0014040 tx=0x7ff6d0004770 comp rx=0 tx=0).stop 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 shutdown_connections 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6e0144800 0x7ff6e0137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6e013e6c0 0x7ff6e01dc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 --2- 172.21.15.151:0/3319763249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6e0071c30 0x7ff6e00b82d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 >> 172.21.15.151:0/3319763249 conn(0x7ff6e00b5610 msgr2=0x7ff6e013c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 shutdown_connections 2024-03-18T18:08:49.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:49.924+0000 7ff6df59e700 1 -- 172.21.15.151:0/3319763249 wait complete. 2024-03-18T18:08:49.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 250ec149-fe27-4c12-910f-aa08e7d49008 6 2024-03-18T18:08:49.940 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:49.936+0000 7f1a08ea62c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T18:08:50.011 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:50.008+0000 7f1a08ea62c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T18:08:50.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 Processor -- start 2024-03-18T18:08:50.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- start start 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 0x7fb29413e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb2941481d0 0x7fb29414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2940b5fc0 con 0x7fb29413e790 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940ba190 con 0x7fb2941481d0 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940b5970 con 0x7fb2940b9db0 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 0x7fb29413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 0x7fb29413e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33830/0 (socket says 172.21.15.151:33830) 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb291d9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb29413e790 0x7fb294147ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:34708/0 (socket says 172.21.15.151:34708) 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 -- 172.21.15.151:0/1936623495 learned_addr learned my addr 172.21.15.151:0/1936623495 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb292d9d700 1 --2- 172.21.15.151:0/1936623495 >> v2:172.21.15.94:3300/0 conn(0x7fb2941481d0 0x7fb29414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29159a700 1 -- 172.21.15.151:0/1936623495 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889142524 0 0) 0x7fb2940b5fc0 con 0x7fb29413e790 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29159a700 1 -- 172.21.15.151:0/1936623495 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb27c0035d0 con 0x7fb29413e790 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 -- 172.21.15.151:0/1936623495 >> v2:172.21.15.94:3300/0 conn(0x7fb2941481d0 msgr2=0x7fb29414ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 --2- 172.21.15.151:0/1936623495 >> v2:172.21.15.94:3300/0 conn(0x7fb2941481d0 0x7fb29414ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 -- 172.21.15.151:0/1936623495 >> v1:172.21.15.151:6789/0 conn(0x7fb29413e790 legacy=0x7fb294147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 -- 172.21.15.151:0/1936623495 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940b5c50 con 0x7fb2940b9db0 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29259c700 1 --2- 172.21.15.151:0/1936623495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 0x7fb29413e250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009e50 tx=0x7fb28c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e41d637ffa6cff20 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29159a700 1 -- 172.21.15.151:0/1936623495 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00e070 con 0x7fb2940b9db0 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29159a700 1 -- 172.21.15.151:0/1936623495 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c00b910 con 0x7fb2940b9db0 2024-03-18T18:08:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29159a700 1 -- 172.21.15.151:0/1936623495 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00bc80 con 0x7fb2940b9db0 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- 172.21.15.151:0/1936623495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 msgr2=0x7fb29413e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 --2- 172.21.15.151:0/1936623495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 0x7fb29413e250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009e50 tx=0x7fb28c00b330 comp rx=0 tx=0).stop 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- 172.21.15.151:0/1936623495 shutdown_connections 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 --2- 172.21.15.151:0/1936623495 >> v2:172.21.15.94:3300/0 conn(0x7fb2941481d0 0x7fb29414ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 --2- 172.21.15.151:0/1936623495 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2940b9db0 0x7fb29413e250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- 172.21.15.151:0/1936623495 >> 172.21.15.151:0/1936623495 conn(0x7fb29406a150 msgr2=0x7fb29406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- 172.21.15.151:0/1936623495 shutdown_connections 2024-03-18T18:08:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.044+0000 7fb29359e700 1 -- 172.21.15.151:0/1936623495 wait complete. 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 Processor -- start 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- start start 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2940b9db0 0x7fb2940b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 0x7fb2941404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2941481d0 0x7fb2941d9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294140a10 con 0x7fb2941481d0 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294140c30 con 0x7fb2940b9db0 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941d9780 con 0x7fb29413e790 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb291d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 0x7fb2941404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2940b9db0 0x7fb2940b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb291d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 0x7fb2941404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33832/0 (socket says 172.21.15.151:33832) 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb291d9b700 1 -- 172.21.15.151:0/23574087 learned_addr learned my addr 172.21.15.151:0/23574087 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb292d9d700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2941481d0 0x7fb2941d9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 -- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 msgr2=0x7fb2941404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 0x7fb2941404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 -- 172.21.15.151:0/23574087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2941481d0 msgr2=0x7fb2941d9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2941481d0 0x7fb2941d9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 -- 172.21.15.151:0/23574087 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009b30 con 0x7fb2940b9db0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb291d9b700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 0x7fb2941404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb292d9d700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2941481d0 0x7fb2941d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29259c700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2940b9db0 0x7fb2940b7d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb2940ba460 tx=0x7fb28c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0048b0 con 0x7fb2940b9db0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c0092e0 con 0x7fb2940b9db0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c01c660 con 0x7fb2940b9db0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2940b83a0 con 0x7fb2940b9db0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb294141890 con 0x7fb2940b9db0 2024-03-18T18:08:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb28c01cac0 con 0x7fb2940b9db0 2024-03-18T18:08:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb28c0123f0 con 0x7fb2940b9db0 2024-03-18T18:08:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.048+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294141a80 con 0x7fb2940b9db0 2024-03-18T18:08:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.052+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb28c020070 con 0x7fb2940b9db0 2024-03-18T18:08:50.079 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:50.076+0000 7f1a08ea62c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T18:08:50.093 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:50.089+0000 7f01c5a542c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T18:08:50.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.124+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "250ec149-fe27-4c12-910f-aa08e7d49008", "id": 6} v 0) v1 -- 0x7fb294074440 con 0x7fb2940b9db0 2024-03-18T18:08:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb282ffd700 1 -- 172.21.15.151:0/23574087 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "250ec149-fe27-4c12-910f-aa08e7d49008", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb28c025450 con 0x7fb2940b9db0 2024-03-18T18:08:50.135 INFO:teuthology.orchestra.run.smithi151.stdout:6 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2940b9db0 msgr2=0x7fb2940b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2940b9db0 0x7fb2940b7d20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb2940ba460 tx=0x7fb28c004af0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 shutdown_connections 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb2941481d0 0x7fb2941d9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb29413e790 0x7fb2941404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 --2- 172.21.15.151:0/23574087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2940b9db0 0x7fb2940b7d20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 >> 172.21.15.151:0/23574087 conn(0x7fb29406a150 msgr2=0x7fb2940b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 shutdown_connections 2024-03-18T18:08:50.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.132+0000 7fb29359e700 1 -- 172.21.15.151:0/23574087 wait complete. 2024-03-18T18:08:50.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31 7 2024-03-18T18:08:50.161 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:50.157+0000 7f01c5a542c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T18:08:50.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.252+0000 7f9da2f59700 1 Processor -- start 2024-03-18T18:08:50.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.252+0000 7f9da2f59700 1 -- start start 2024-03-18T18:08:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d9c0af930 0x7f9d9c143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c0afd90 con 0x7f9d9c13d450 2024-03-18T18:08:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c143b20 con 0x7f9d9c073240 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c072bd0 con 0x7f9d9c0af930 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d9c0af930 0x7f9d9c143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d9c0af930 0x7f9d9c143fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56888/0 (socket says 172.21.15.151:56888) 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 -- 172.21.15.151:0/16874060 learned_addr learned my addr 172.21.15.151:0/16874060 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 -- 172.21.15.151:0/16874060 >> v1:172.21.15.151:6789/0 conn(0x7f9d9c073240 legacy=0x7f9d9c0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 -- 172.21.15.151:0/16874060 >> v1:172.21.15.94:6789/0 conn(0x7f9d9c13d450 legacy=0x7f9d9c14dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 -- 172.21.15.151:0/16874060 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c06f5c0 con 0x7f9d9c0af930 2024-03-18T18:08:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9bfff700 1 --2- 172.21.15.151:0/16874060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c143fb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009910 tx=0x7f9d8c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=671b2660b28d0c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9b7fe700 1 -- 172.21.15.151:0/16874060 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c00ba60 con 0x7f9d9c0af930 2024-03-18T18:08:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9b7fe700 1 -- 172.21.15.151:0/16874060 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c00bbc0 con 0x7f9d9c0af930 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9d9b7fe700 1 -- 172.21.15.151:0/16874060 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c009e60 con 0x7f9d9c0af930 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- 172.21.15.151:0/16874060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 msgr2=0x7f9d9c143fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 --2- 172.21.15.151:0/16874060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c143fb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009910 tx=0x7f9d8c009c20 comp rx=0 tx=0).stop 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- 172.21.15.151:0/16874060 shutdown_connections 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 --2- 172.21.15.151:0/16874060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c143fb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- 172.21.15.151:0/16874060 >> 172.21.15.151:0/16874060 conn(0x7f9d9c0b8430 msgr2=0x7f9d9c0b8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- 172.21.15.151:0/16874060 shutdown_connections 2024-03-18T18:08:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.256+0000 7f9da2f59700 1 -- 172.21.15.151:0/16874060 wait complete. 2024-03-18T18:08:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 Processor -- start 2024-03-18T18:08:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- start start 2024-03-18T18:08:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9c073240 0x7f9d9c1ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c1cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9c13d450 0x7f9d9c1c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1cada0 con 0x7f9d9c13d450 2024-03-18T18:08:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1cc0d0 con 0x7f9d9c0af930 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c1cafb0 con 0x7f9d9c073240 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c1cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da0cf5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9c073240 0x7f9d9c1ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c1cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56890/0 (socket says 172.21.15.151:56890) 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 -- 172.21.15.151:0/1642850151 learned_addr learned my addr 172.21.15.151:0/1642850151 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da14f6700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9c13d450 0x7f9d9c1c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 -- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9c073240 msgr2=0x7f9d9c1ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9c073240 0x7f9d9c1ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 -- 172.21.15.151:0/1642850151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9c13d450 msgr2=0x7f9d9c1c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9c13d450 0x7f9d9c1c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 -- 172.21.15.151:0/1642850151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009570 con 0x7f9d9c0af930 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d9bfff700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c1cba70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c000c00 tx=0x7f9d8c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c004610 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c01f070 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0038e0 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c141110 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c1ca910 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9d8c003d40 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9d8c021070 con 0x7f9d9c0af930 2024-03-18T18:08:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.260+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c0b4d00 con 0x7f9d9c0af930 2024-03-18T18:08:50.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.268+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f9d8c045b50 con 0x7f9d9c0af930 2024-03-18T18:08:50.321 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:50.317+0000 7f01c5a542c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T18:08:50.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.344+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31", "id": 7} v 0) v1 -- 0x7f9d9c1c9ea0 con 0x7f9d9c0af930 2024-03-18T18:08:50.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.348+0000 7f9d997fa700 1 -- 172.21.15.151:0/1642850151 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d9c1c9ea0 con 0x7f9d9c0af930 2024-03-18T18:08:50.354 INFO:teuthology.orchestra.run.smithi151.stdout:7 2024-03-18T18:08:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 msgr2=0x7f9d9c1cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c1cba70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c000c00 tx=0x7f9d8c004770 comp rx=0 tx=0).stop 2024-03-18T18:08:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 shutdown_connections 2024-03-18T18:08:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9d9c13d450 0x7f9d9c1c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9c0af930 0x7f9d9c1cba70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 --2- 172.21.15.151:0/1642850151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9c073240 0x7f9d9c1ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 >> 172.21.15.151:0/1642850151 conn(0x7f9d9c0b8430 msgr2=0x7f9d9c0665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:50.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 shutdown_connections 2024-03-18T18:08:50.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-18T18:08:50.352+0000 7f9da2f59700 1 -- 172.21.15.151:0/1642850151 wait complete. 2024-03-18T18:08:50.369 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-18T18:08:50.370 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-18T18:08:50.372 INFO:tasks.ceph.osd.0:Started 2024-03-18T18:08:50.372 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-18T18:08:50.372 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-18T18:08:50.374 INFO:tasks.ceph.osd.1:Started 2024-03-18T18:08:50.374 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-18T18:08:50.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-18T18:08:50.376 INFO:tasks.ceph.osd.2:Started 2024-03-18T18:08:50.376 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-18T18:08:50.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-18T18:08:50.379 INFO:tasks.ceph.osd.3:Started 2024-03-18T18:08:50.379 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-18T18:08:50.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-18T18:08:50.381 INFO:tasks.ceph.osd.4:Started 2024-03-18T18:08:50.381 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-18T18:08:50.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-18T18:08:50.383 INFO:tasks.ceph.osd.5:Started 2024-03-18T18:08:50.383 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-18T18:08:50.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-18T18:08:50.385 INFO:tasks.ceph.osd.6:Started 2024-03-18T18:08:50.385 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-18T18:08:50.385 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-18T18:08:50.387 INFO:tasks.ceph.osd.7:Started 2024-03-18T18:08:50.387 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:08:50.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.493+0000 7f422cfe6700 1 Processor -- start 2024-03-18T18:08:50.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.493+0000 7f422cfe6700 1 -- start start 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.493+0000 7f422cfe6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f422806e7d0 0x7f42280b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.493+0000 7f422cfe6700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280b19e0 con 0x7f422806ebb0 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4228144850 con 0x7f4228144d70 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422806faf0 con 0x7f422806e7d0 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f4225d9b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f422806ebb0 0x7f4228071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55740/0 (socket says 172.21.15.94:55740) 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f4225d9b700 1 -- 172.21.15.94:0/1948179791 learned_addr learned my addr 172.21.15.94:0/1948179791 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:08:50.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422659c700 1 --2- 172.21.15.94:0/1948179791 >> v2:172.21.15.151:3300/0 conn(0x7f422806e7d0 0x7f42280b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338158677 0 0) 0x7f42280b19e0 con 0x7f422806ebb0 2024-03-18T18:08:50.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42100035d0 con 0x7f422806ebb0 2024-03-18T18:08:50.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430095490 0 0) 0x7f4228144850 con 0x7f4228144d70 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42280b19e0 con 0x7f4228144d70 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422659c700 1 -- 172.21.15.94:0/1948179791 >> v1:172.21.15.151:6789/0 conn(0x7f4228144d70 legacy=0x7f422814eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071624867 0 0) 0x7f42100035d0 con 0x7f422806ebb0 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422659c700 1 -- 172.21.15.94:0/1948179791 >> v1:172.21.15.94:6789/0 conn(0x7f422806ebb0 legacy=0x7f4228071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422659c700 1 -- 172.21.15.94:0/1948179791 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422806fcd0 con 0x7f422806e7d0 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422659c700 1 --2- 172.21.15.94:0/1948179791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806e7d0 0x7f42280b1310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4218009850 tx=0x7f4218009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2ef347761255f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c001670 con 0x7f422806e7d0 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218004030 con 0x7f422806e7d0 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422559a700 1 -- 172.21.15.94:0/1948179791 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180043c0 con 0x7f422806e7d0 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- 172.21.15.94:0/1948179791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806e7d0 msgr2=0x7f42280b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 --2- 172.21.15.94:0/1948179791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806e7d0 0x7f42280b1310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4218009850 tx=0x7f4218009b60 comp rx=0 tx=0).stop 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- 172.21.15.94:0/1948179791 shutdown_connections 2024-03-18T18:08:50.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 --2- 172.21.15.94:0/1948179791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806e7d0 0x7f42280b1310 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- 172.21.15.94:0/1948179791 >> 172.21.15.94:0/1948179791 conn(0x7f42280b7c00 msgr2=0x7f42280b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- 172.21.15.94:0/1948179791 shutdown_connections 2024-03-18T18:08:50.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- 172.21.15.94:0/1948179791 wait complete. 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 Processor -- start 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- start start 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f422806e7d0 0x7f42280aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806ebb0 0x7f42281dd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 0x7f42281dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280ac000 con 0x7f4228144d70 2024-03-18T18:08:50.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228141460 con 0x7f422806ebb0 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.497+0000 7f422cfe6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228140e50 con 0x7f422806e7d0 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4226d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 0x7f42281dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4225d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806ebb0 0x7f42281dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f422806e7d0 0x7f42280aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4226d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 0x7f42281dd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58190/0 (socket says 172.21.15.94:58190) 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4226d9d700 1 -- 172.21.15.94:0/249868901 learned_addr learned my addr 172.21.15.94:0/249868901 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 -- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806ebb0 msgr2=0x7f42281dd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806ebb0 0x7f42281dd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 -- 172.21.15.94:0/249868901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 msgr2=0x7f42281dd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 0x7f42281dd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 -- 172.21.15.94:0/249868901 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180094b0 con 0x7f422806e7d0 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4226d9d700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 0x7f42281dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4225d9b700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806ebb0 0x7f42281dd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:50.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422659c700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f422806e7d0 0x7f42280aaf10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4218015000 tx=0x7f4218004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218003c30 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421801f070 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42280ac4e0 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218011630 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42280ac200 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4218021030 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f421801ade0 con 0x7f422806e7d0 2024-03-18T18:08:50.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.501+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4228068310 con 0x7f422806e7d0 2024-03-18T18:08:50.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.505+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f4218011a90 con 0x7f422806e7d0 2024-03-18T18:08:50.537 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:50.532+0000 7f1a08ea62c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T18:08:50.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42280b6c60 con 0x7f422806e7d0 2024-03-18T18:08:50.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f4216ffd700 1 -- 172.21.15.94:0/249868901 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4218011c30 con 0x7f422806e7d0 2024-03-18T18:08:50.596 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:08:50.597 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:08:50.351061+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f422806e7d0 msgr2=0x7f42280aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f422806e7d0 0x7f42280aaf10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4218015000 tx=0x7f4218004770 comp rx=0 tx=0).stop 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 shutdown_connections 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4228144d70 0x7f42281dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f422806ebb0 0x7f42281dd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 --2- 172.21.15.94:0/249868901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f422806e7d0 0x7f42280aaf10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 >> 172.21.15.94:0/249868901 conn(0x7f42280b7c00 msgr2=0x7f42280b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 shutdown_connections 2024-03-18T18:08:50.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:08:50.593+0000 7f422cfe6700 1 -- 172.21.15.94:0/249868901 wait complete. 2024-03-18T18:08:50.609 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-18T18:08:50.609 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-18T18:08:50.662 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:50.656+0000 7f1a08ea62c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T18:08:50.728 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-03-18T18:08:50.725+0000 7fb173f91700 -1 Falling back to public interface 2024-03-18T18:08:50.736 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-03-18T18:08:50.733+0000 7f29d23f1700 -1 Falling back to public interface 2024-03-18T18:08:50.737 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-03-18T18:08:50.733+0000 7f0bfa940700 -1 Falling back to public interface 2024-03-18T18:08:50.759 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-03-18T18:08:50.757+0000 7f4cae96d700 -1 Falling back to public interface 2024-03-18T18:08:51.009 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-18T18:08:51.004+0000 7f690cb49700 -1 Falling back to public interface 2024-03-18T18:08:51.020 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-18T18:08:51.016+0000 7f6627a21700 -1 Falling back to public interface 2024-03-18T18:08:51.021 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:51.016+0000 7f1a08ea62c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T18:08:51.028 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-18T18:08:51.024+0000 7f315ed39700 -1 Falling back to public interface 2024-03-18T18:08:51.032 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-18T18:08:51.028+0000 7fb1ba07c700 -1 Falling back to public interface 2024-03-18T18:08:51.044 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.041+0000 7f01c5a542c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-18T18:08:51.114 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.113+0000 7f01c5a542c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T18:08:51.205 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:51.200+0000 7f1a08ea62c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T18:08:51.273 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:51.268+0000 7f1a08ea62c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T18:08:51.282 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.277+0000 7f01c5a542c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T18:08:51.349 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.345+0000 7f01c5a542c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T18:08:51.416 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T18:08:51.425 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.421+0000 7f01c5a542c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T18:08:51.432 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:51.428+0000 7f1a08ea62c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T18:08:51.516 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 Processor -- start 2024-03-18T18:08:51.516 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 -- start start 2024-03-18T18:08:51.517 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a801473b0 0x7f8a80143880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:51.517 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a80143dc0 0x7f8a80140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a801468d0 con 0x7f8a801434a0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a80146bb0 con 0x7f8a801473b0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a84822700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80146e90 con 0x7f8a80143dc0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a801473b0 0x7f8a80143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a801473b0 0x7f8a80143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58200/0 (socket says 172.21.15.94:58200) 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a7f7fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8a801434a0 0x7f8a80070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:55752/0 (socket says 172.21.15.94:55752) 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 -- 172.21.15.94:0/544495923 learned_addr learned my addr 172.21.15.94:0/544495923 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a7ffff700 1 --2- 172.21.15.94:0/544495923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a80143dc0 0x7f8a80140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 -- 172.21.15.94:0/544495923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a80143dc0 msgr2=0x7f8a80140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 --2- 172.21.15.94:0/544495923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a80143dc0 0x7f8a80140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 -- 172.21.15.94:0/544495923 >> v1:172.21.15.94:6789/0 conn(0x7f8a801434a0 legacy=0x7f8a80070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 -- 172.21.15.94:0/544495923 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800afd50 con 0x7f8a801473b0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a7effd700 1 -- 172.21.15.94:0/544495923 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027477022 0 0) 0x7f8a801468d0 con 0x7f8a801434a0 2024-03-18T18:08:51.518 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a77fff700 1 --2- 172.21.15.94:0/544495923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a801473b0 0x7f8a80143880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009910 tx=0x7f8a68009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ebefcffdee2bfe server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:51.519 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a7effd700 1 -- 172.21.15.94:0/544495923 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800ba60 con 0x7f8a801473b0 2024-03-18T18:08:51.519 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a7effd700 1 -- 172.21.15.94:0/544495923 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6800bbc0 con 0x7f8a801473b0 2024-03-18T18:08:51.519 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.513+0000 7f8a7effd700 1 -- 172.21.15.94:0/544495923 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68009e60 con 0x7f8a801473b0 2024-03-18T18:08:51.519 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- 172.21.15.94:0/544495923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a801473b0 msgr2=0x7f8a80143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:51.519 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 --2- 172.21.15.94:0/544495923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a801473b0 0x7f8a80143880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009910 tx=0x7f8a68009c20 comp rx=0 tx=0).stop 2024-03-18T18:08:51.519 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- 172.21.15.94:0/544495923 shutdown_connections 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 --2- 172.21.15.94:0/544495923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a80143dc0 0x7f8a80140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 --2- 172.21.15.94:0/544495923 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a801473b0 0x7f8a80143880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- 172.21.15.94:0/544495923 >> 172.21.15.94:0/544495923 conn(0x7f8a800b5770 msgr2=0x7f8a800b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- 172.21.15.94:0/544495923 shutdown_connections 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- 172.21.15.94:0/544495923 wait complete. 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 Processor -- start 2024-03-18T18:08:51.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- start start 2024-03-18T18:08:51.522 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a801434a0 0x7f8a800b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 0x7f8a800b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a801473b0 0x7f8a80145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800b52a0 con 0x7f8a80143dc0 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8013f9a0 con 0x7f8a801434a0 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a84822700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800b3c70 con 0x7f8a801473b0 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 0x7f8a800b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 0x7f8a800b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:58210/0 (socket says 172.21.15.94:58210) 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a77fff700 1 -- 172.21.15.94:0/1618821490 learned_addr learned my addr 172.21.15.94:0/1618821490 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a7f7fe700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a801434a0 0x7f8a800b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.517+0000 7f8a7ffff700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a801473b0 0x7f8a80145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a77fff700 1 -- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a801473b0 msgr2=0x7f8a80145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a77fff700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a801473b0 0x7f8a80145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a77fff700 1 -- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a801434a0 msgr2=0x7f8a800b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a77fff700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a801434a0 0x7f8a800b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a77fff700 1 -- 172.21.15.94:0/1618821490 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009570 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a77fff700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 0x7f8a800b4190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009c60 tx=0x7f8a68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68004610 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6801e070 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8013fc40 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680038e0 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a80146220 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8a68003d40 con 0x7f8a80143dc0 2024-03-18T18:08:51.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8a68020070 con 0x7f8a80143dc0 2024-03-18T18:08:51.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.521+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a80067b30 con 0x7f8a80143dc0 2024-03-18T18:08:51.528 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.525+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f8a68045b50 con 0x7f8a80143dc0 2024-03-18T18:08:51.594 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a8006e510 con 0x7f8a80143dc0 2024-03-18T18:08:51.595 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a7cff9700 1 -- 172.21.15.94:0/1618821490 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8a68034070 con 0x7f8a80143dc0 2024-03-18T18:08:51.595 INFO:teuthology.misc.health.smithi094.stdout: 2024-03-18T18:08:51.595 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:08:50.351061+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 msgr2=0x7f8a800b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 0x7f8a800b4190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009c60 tx=0x7f8a68004770 comp rx=0 tx=0).stop 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 shutdown_connections 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a801473b0 0x7f8a80145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a80143dc0 0x7f8a800b4190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 --2- 172.21.15.94:0/1618821490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a801434a0 0x7f8a800b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 >> 172.21.15.94:0/1618821490 conn(0x7f8a800b5770 msgr2=0x7f8a80070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 shutdown_connections 2024-03-18T18:08:51.597 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:51.593+0000 7f8a84822700 1 -- 172.21.15.94:0/1618821490 wait complete. 2024-03-18T18:08:51.607 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-18T18:08:51.750 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.749+0000 7f01c5a542c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T18:08:51.827 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:51.825+0000 7f01c5a542c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T18:08:52.141 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.136+0000 7f1a08ea62c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-18T18:08:52.212 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.208+0000 7f1a08ea62c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T18:08:52.390 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.384+0000 7f1a08ea62c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T18:08:52.458 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.452+0000 7f1a08ea62c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T18:08:52.518 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:52.517+0000 7f01c5a542c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T18:08:52.535 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.532+0000 7f1a08ea62c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T18:08:52.860 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.856+0000 7f1a08ea62c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T18:08:52.937 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:52.932+0000 7f1a08ea62c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T18:08:53.563 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:53.561+0000 7f01ac611700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-18T18:08:53.566 INFO:tasks.ceph.mgr.y.smithi094.stderr:2024-03-18T18:08:53.565+0000 7f01ac611700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-18T18:08:53.648 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-18T18:08:53.644+0000 7f1a08ea62c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T18:08:54.201 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-03-18T18:08:54.197+0000 7fb173f91700 -1 osd.0 0 log_to_monitors true 2024-03-18T18:08:54.436 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-03-18T18:08:54.433+0000 7f0bfa940700 -1 osd.3 0 log_to_monitors true 2024-03-18T18:08:54.591 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-03-18T18:08:54.589+0000 7f29d23f1700 -1 osd.1 0 log_to_monitors true 2024-03-18T18:08:54.609 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-18T18:08:54.604+0000 7f6627a21700 -1 osd.5 0 log_to_monitors true 2024-03-18T18:08:54.609 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-03-18T18:08:54.605+0000 7f4cae96d700 -1 osd.2 0 log_to_monitors true 2024-03-18T18:08:54.640 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-18T18:08:54.636+0000 7fb1ba07c700 -1 osd.4 0 log_to_monitors true 2024-03-18T18:08:54.812 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-18T18:08:54.808+0000 7f690cb49700 -1 osd.7 0 log_to_monitors true 2024-03-18T18:08:54.902 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-18T18:08:54.896+0000 7f315ed39700 -1 osd.6 0 log_to_monitors true 2024-03-18T18:08:56.919 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-03-18T18:08:56.917+0000 7fb170f58700 -1 osd.0 0 waiting for initial osdmap 2024-03-18T18:08:56.919 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-03-18T18:08:56.917+0000 7f0bf5f5c700 -1 osd.3 0 waiting for initial osdmap 2024-03-18T18:08:56.931 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-03-18T18:08:56.929+0000 7fb167882700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:56.931 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-03-18T18:08:56.929+0000 7f0bee231700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:57.864 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-03-18T18:08:57.861+0000 7f4ca9f89700 -1 osd.2 0 waiting for initial osdmap 2024-03-18T18:08:57.870 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-03-18T18:08:57.869+0000 7f29cf3b8700 -1 osd.1 0 waiting for initial osdmap 2024-03-18T18:08:57.877 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-03-18T18:08:57.873+0000 7f29c5ce2700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:58.017 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-03-18T18:08:58.013+0000 7f4ca225e700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:58.414 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T18:08:58.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4ad4cb700 1 Processor -- start 2024-03-18T18:08:58.520 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4ad4cb700 1 -- start start 2024-03-18T18:08:58.521 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4ad4cb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b1cd0 0x7fb4a806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:58.521 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4ad4cb700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a80afdc0 con 0x7fb4a80b0250 2024-03-18T18:08:58.521 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4ad4cb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a80b20b0 con 0x7fb4a81412b0 2024-03-18T18:08:58.522 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4ad4cb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a80b1360 con 0x7fb4a80b1cd0 2024-03-18T18:08:58.522 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4a77fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb4a80b0250 0x7fb4a80b3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:50182/0 (socket says 172.21.15.94:50182) 2024-03-18T18:08:58.522 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4a77fe700 1 -- 172.21.15.94:0/950829696 learned_addr learned my addr 172.21.15.94:0/950829696 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:08:58.522 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.517+0000 7fb4a7fff700 1 --2- 172.21.15.94:0/950829696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b1cd0 0x7fb4a806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:58.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223378945 0 0) 0x7fb4a80afdc0 con 0x7fb4a80b0250 2024-03-18T18:08:58.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4900035d0 con 0x7fb4a80b0250 2024-03-18T18:08:58.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675277818 0 0) 0x7fb4a80b20b0 con 0x7fb4a81412b0 2024-03-18T18:08:58.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a80afdc0 con 0x7fb4a81412b0 2024-03-18T18:08:58.523 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a7fff700 1 -- 172.21.15.94:0/950829696 >> v1:172.21.15.151:6789/0 conn(0x7fb4a81412b0 legacy=0x7fb4a8141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a7fff700 1 -- 172.21.15.94:0/950829696 >> v1:172.21.15.94:6789/0 conn(0x7fb4a80b0250 legacy=0x7fb4a80b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a7fff700 1 -- 172.21.15.94:0/950829696 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a806c9f0 con 0x7fb4a80b1cd0 2024-03-18T18:08:58.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a7fff700 1 --2- 172.21.15.94:0/950829696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b1cd0 0x7fb4a806c3d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009880 tx=0x7fb49c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2508cc61b521a1f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:58.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c011830 con 0x7fb4a80b1cd0 2024-03-18T18:08:58.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c011990 con 0x7fb4a80b1cd0 2024-03-18T18:08:58.524 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4a6ffd700 1 -- 172.21.15.94:0/950829696 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c011d20 con 0x7fb4a80b1cd0 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/950829696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b1cd0 msgr2=0x7fb4a806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/950829696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b1cd0 0x7fb4a806c3d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009880 tx=0x7fb49c009b90 comp rx=0 tx=0).stop 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/950829696 shutdown_connections 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/950829696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b1cd0 0x7fb4a806c3d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/950829696 >> 172.21.15.94:0/950829696 conn(0x7fb4a806a150 msgr2=0x7fb4a806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/950829696 shutdown_connections 2024-03-18T18:08:58.525 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.521+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/950829696 wait complete. 2024-03-18T18:08:58.526 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 Processor -- start 2024-03-18T18:08:58.526 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 -- start start 2024-03-18T18:08:58.528 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b0250 0x7fb4a81386c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:58.528 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a81412b0 0x7fb4a81dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:58.528 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 0x7fb4a8135ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a806ccd0 con 0x7fb4a81412b0 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81447b0 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81ddd80 con 0x7fb4a80b0250 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b0250 0x7fb4a81386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 0x7fb4a8135ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a77fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a81412b0 0x7fb4a81dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 0x7fb4a8135ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57382/0 (socket says 172.21.15.94:57382) 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b0250 0x7fb4a81386c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:54944/0 (socket says 172.21.15.94:54944) 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 -- 172.21.15.94:0/4243033214 learned_addr learned my addr 172.21.15.94:0/4243033214 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 -- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b0250 msgr2=0x7fb4a81386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b0250 0x7fb4a81386c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 -- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a81412b0 msgr2=0x7fb4a81dd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.529 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a81412b0 0x7fb4a81dd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 -- 172.21.15.94:0/4243033214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c0094b0 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a77fe700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a81412b0 0x7fb4a81dd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4accca700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 0x7fb4a8135ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000cbf0 tx=0x7fb4a000cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0003c20 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a0003d80 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a814f920 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a000aa60 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.530 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.525+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a8144160 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.531 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.529+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a8144960 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.531 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.529+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 86028+0+0 (secure 0 0 0) 0x7fb4a000abc0 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.531 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.529+0000 7fb4a4ff9700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb4940666a0 0x7fb494068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:08:58.531 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.529+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7fb4a00833e0 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.531 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.529+0000 7fb4a7fff700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb4940666a0 0x7fb494068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:08:58.532 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.529+0000 7fb4a7fff700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb4940666a0 0x7fb494068b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4a806db90 tx=0x7fb49c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:08:58.539 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.537+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb4a0051420 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.715 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.713+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4a8073cf0 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.716 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.713+0000 7fb4a4ff9700 1 -- 172.21.15.94:0/4243033214 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7908 (secure 0 0 0) 0x7fb4a0054a40 con 0x7fb4a81dd8f0 2024-03-18T18:08:58.716 INFO:teuthology.misc.health.smithi094.stdout: 2024-03-18T18:08:58.717 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":14,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:08:57.603402+0000","last_up_change":"2024-03-18T18:08:57.603402+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:08:58.719 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb4940666a0 msgr2=0x7fb494068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.719 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb4940666a0 0x7fb494068b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4a806db90 tx=0x7fb49c01c040 comp rx=0 tx=0).stop 2024-03-18T18:08:58.719 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 msgr2=0x7fb4a8135ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:08:58.719 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 0x7fb4a8135ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000cbf0 tx=0x7fb4a000cf00 comp rx=0 tx=0).stop 2024-03-18T18:08:58.719 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 shutdown_connections 2024-03-18T18:08:58.719 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb4940666a0 0x7fb494068b60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.720 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4a81dd8f0 0x7fb4a8135ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.720 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4a81412b0 0x7fb4a81dd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.720 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 --2- 172.21.15.94:0/4243033214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4a80b0250 0x7fb4a81386c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:08:58.720 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 >> 172.21.15.94:0/4243033214 conn(0x7fb4a806a150 msgr2=0x7fb4a806bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:08:58.720 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 shutdown_connections 2024-03-18T18:08:58.720 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:08:58.717+0000 7fb4ad4cb700 1 -- 172.21.15.94:0/4243033214 wait complete. 2024-03-18T18:08:58.730 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-03-18T18:08:58.842 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-18T18:08:58.836+0000 7f662303d700 -1 osd.5 0 waiting for initial osdmap 2024-03-18T18:08:58.848 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-18T18:08:58.844+0000 7f315a355700 -1 osd.6 0 waiting for initial osdmap 2024-03-18T18:08:58.850 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-18T18:08:58.844+0000 7f661b312700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:58.854 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-18T18:08:58.848+0000 7f315262a700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:58.896 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-18T18:08:58.892+0000 7f6908165700 -1 osd.7 0 waiting for initial osdmap 2024-03-18T18:08:58.901 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-18T18:08:58.896+0000 7fb1b5698700 -1 osd.4 0 waiting for initial osdmap 2024-03-18T18:08:58.904 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-18T18:08:58.900+0000 7f690043a700 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:08:58.910 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-18T18:08:58.904+0000 7fb1ad96d700 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T18:09:05.537 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:05.647 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 Processor -- start 2024-03-18T18:09:05.648 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 -- start start 2024-03-18T18:09:05.650 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa98006c640 0x7fa9800ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa9800ad730 0x7fa9800b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9800b4620 con 0x7fa9800adbb0 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9800ae800 con 0x7fa9800ad730 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa987319700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98006ca20 con 0x7fa98006c640 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa9800ad730 0x7fa9800b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa9800ad730 0x7fa9800b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45030/0 (socket says 172.21.15.94:45030) 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 -- 172.21.15.94:0/2360008890 learned_addr learned my addr 172.21.15.94:0/2360008890 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa986317700 1 --2- 172.21.15.94:0/2360008890 >> v2:172.21.15.151:3300/0 conn(0x7fa98006c640 0x7fa9800ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 -- 172.21.15.94:0/2360008890 >> v2:172.21.15.151:3300/0 conn(0x7fa98006c640 msgr2=0x7fa9800ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 --2- 172.21.15.94:0/2360008890 >> v2:172.21.15.151:3300/0 conn(0x7fa98006c640 0x7fa9800ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 -- 172.21.15.94:0/2360008890 >> v1:172.21.15.151:6789/0 conn(0x7fa9800adbb0 legacy=0x7fa9800b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.651 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 -- 172.21.15.94:0/2360008890 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800af400 con 0x7fa9800ad730 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985b16700 1 --2- 172.21.15.94:0/2360008890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800ad730 0x7fa9800b2760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa980072d30 tx=0x7fa974009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d808edb7843d0ba1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.645+0000 7fa985315700 1 -- 172.21.15.94:0/2360008890 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97400b8a0 con 0x7fa9800ad730 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa985315700 1 -- 172.21.15.94:0/2360008890 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97400ba00 con 0x7fa9800ad730 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa985315700 1 -- 172.21.15.94:0/2360008890 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97400bd90 con 0x7fa9800ad730 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 -- 172.21.15.94:0/2360008890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800ad730 msgr2=0x7fa9800b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 --2- 172.21.15.94:0/2360008890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800ad730 0x7fa9800b2760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa980072d30 tx=0x7fa974009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 -- 172.21.15.94:0/2360008890 shutdown_connections 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 --2- 172.21.15.94:0/2360008890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800ad730 0x7fa9800b2760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 --2- 172.21.15.94:0/2360008890 >> v2:172.21.15.151:3300/0 conn(0x7fa98006c640 0x7fa9800ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 -- 172.21.15.94:0/2360008890 >> 172.21.15.94:0/2360008890 conn(0x7fa98006a150 msgr2=0x7fa98006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 -- 172.21.15.94:0/2360008890 shutdown_connections 2024-03-18T18:09:05.652 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 -- 172.21.15.94:0/2360008890 wait complete. 2024-03-18T18:09:05.653 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 Processor -- start 2024-03-18T18:09:05.653 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.649+0000 7fa987319700 1 -- start start 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa98006c640 0x7fa9801e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800ad730 0x7fa9801ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 0x7fa9801cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801dfa40 con 0x7fa9800adbb0 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801cef00 con 0x7fa98006c640 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801cf790 con 0x7fa9800ad730 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 0x7fa9801cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 0x7fa9801cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45042/0 (socket says 172.21.15.94:45042) 2024-03-18T18:09:05.656 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 -- 172.21.15.94:0/285869212 learned_addr learned my addr 172.21.15.94:0/285869212 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986317700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa98006c640 0x7fa9801e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa985b16700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800ad730 0x7fa9801ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 -- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800ad730 msgr2=0x7fa9801ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800ad730 0x7fa9801ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 -- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa98006c640 msgr2=0x7fa9801e0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa98006c640 0x7fa9801e0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 -- 172.21.15.94:0/285869212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974009570 con 0x7fa9800adbb0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa985b16700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800ad730 0x7fa9801ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986317700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa98006c640 0x7fa9801e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa986b18700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 0x7fa9801cd6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa97800cb80 tx=0x7fa97800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978003c20 con 0x7fa9800adbb0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978003d80 con 0x7fa9800adbb0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9801e0990 con 0x7fa9800adbb0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800abb0 con 0x7fa9800adbb0 2024-03-18T18:09:05.657 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9801cec90 con 0x7fa9800adbb0 2024-03-18T18:09:05.658 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.653+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa980073cf0 con 0x7fa9800adbb0 2024-03-18T18:09:05.658 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.657+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa97800ad10 con 0x7fa9800adbb0 2024-03-18T18:09:05.659 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.657+0000 7fa972ffd700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa964066730 0x7fa964068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.659 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.657+0000 7fa986317700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa964066730 0x7fa964068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.659 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.657+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa978083e10 con 0x7fa9800adbb0 2024-03-18T18:09:05.660 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.657+0000 7fa986317700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa964066730 0x7fa964068bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9800719c0 tx=0x7fa97c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:05.666 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.665+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa978087030 con 0x7fa9800adbb0 2024-03-18T18:09:05.840 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.837+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9801d3640 con 0x7fa9800adbb0 2024-03-18T18:09:05.841 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.837+0000 7fa972ffd700 1 -- 172.21.15.94:0/285869212 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12383 (secure 0 0 0) 0x7fa9780514c0 con 0x7fa9800adbb0 2024-03-18T18:09:05.842 INFO:teuthology.misc.health.smithi094.stdout: 2024-03-18T18:09:05.842 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":18,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:01.890484+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:05.844 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa964066730 msgr2=0x7fa964068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.844 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa964066730 0x7fa964068bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa9800719c0 tx=0x7fa97c008040 comp rx=0 tx=0).stop 2024-03-18T18:09:05.844 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 msgr2=0x7fa9801cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.844 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 0x7fa9801cd6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa97800cb80 tx=0x7fa97800cf40 comp rx=0 tx=0).stop 2024-03-18T18:09:05.844 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 shutdown_connections 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa964066730 0x7fa964068bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa9800adbb0 0x7fa9801cd6b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800ad730 0x7fa9801ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 --2- 172.21.15.94:0/285869212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa98006c640 0x7fa9801e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 >> 172.21.15.94:0/285869212 conn(0x7fa98006a150 msgr2=0x7fa9800b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 shutdown_connections 2024-03-18T18:09:05.845 INFO:teuthology.misc.health.smithi094.stderr:2024-03-18T18:09:05.841+0000 7fa987319700 1 -- 172.21.15.94:0/285869212 wait complete. 2024-03-18T18:09:05.855 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-18T18:09:05.856 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-18T18:09:05.856 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T18:09:05.856 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T18:09:05.858 INFO:tasks.ceph.mds.a:Started 2024-03-18T18:09:05.858 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T18:09:05.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T18:09:05.861 INFO:tasks.ceph.mds.b:Started 2024-03-18T18:09:05.861 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-18T18:09:05.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:05.938 INFO:tasks.ceph.mds.a.smithi094.stdout:starting mds.a at 2024-03-18T18:09:05.946 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2024-03-18T18:09:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0af59e700 1 Processor -- start 2024-03-18T18:09:05.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0af59e700 1 -- start start 2024-03-18T18:09:05.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00bc780 0x7fb0b0149be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0af59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b014a5a0 con 0x7fb0b014a120 2024-03-18T18:09:05.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0af59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b00b4c10 con 0x7fb0b00b6e90 2024-03-18T18:09:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0af59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b5ee0 con 0x7fb0b00bc780 2024-03-18T18:09:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0add9b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb0b014a120 0x7fb0b00b6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46570/0 (socket says 172.21.15.94:46570) 2024-03-18T18:09:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0add9b700 1 -- 172.21.15.94:0/784014752 learned_addr learned my addr 172.21.15.94:0/784014752 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:05.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ae59c700 1 --2- 172.21.15.94:0/784014752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00bc780 0x7fb0b0149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ad59a700 1 -- 172.21.15.94:0/784014752 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512247490 0 0) 0x7fb0a4001110 con 0x7fb0b014a120 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ad59a700 1 -- 172.21.15.94:0/784014752 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0980035d0 con 0x7fb0b014a120 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ad59a700 1 -- 172.21.15.94:0/784014752 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927396588 0 0) 0x7fb0b00b4c10 con 0x7fb0b00b6e90 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ae59c700 1 -- 172.21.15.94:0/784014752 >> v1:172.21.15.151:6789/0 conn(0x7fb0b00b6e90 legacy=0x7fb0b01510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ae59c700 1 -- 172.21.15.94:0/784014752 >> v1:172.21.15.94:6789/0 conn(0x7fb0b014a120 legacy=0x7fb0b00b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ae59c700 1 -- 172.21.15.94:0/784014752 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00bcb60 con 0x7fb0b00bc780 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.969+0000 7fb0ae59c700 1 --2- 172.21.15.94:0/784014752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00bc780 0x7fb0b0149be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009dc0 tx=0x7fb0a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bef09b7851265e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0ad59a700 1 -- 172.21.15.94:0/784014752 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000e070 con 0x7fb0b00bc780 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0ad59a700 1 -- 172.21.15.94:0/784014752 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a000bb20 con 0x7fb0b00bc780 2024-03-18T18:09:05.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0ad59a700 1 -- 172.21.15.94:0/784014752 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000bed0 con 0x7fb0b00bc780 2024-03-18T18:09:05.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 -- 172.21.15.94:0/784014752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00bc780 msgr2=0x7fb0b0149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 --2- 172.21.15.94:0/784014752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00bc780 0x7fb0b0149be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009dc0 tx=0x7fb0a000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 -- 172.21.15.94:0/784014752 shutdown_connections 2024-03-18T18:09:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 --2- 172.21.15.94:0/784014752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00bc780 0x7fb0b0149be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 -- 172.21.15.94:0/784014752 >> 172.21.15.94:0/784014752 conn(0x7fb0b0073600 msgr2=0x7fb0b00bbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 -- 172.21.15.94:0/784014752 shutdown_connections 2024-03-18T18:09:05.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 -- 172.21.15.94:0/784014752 wait complete. 2024-03-18T18:09:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.973+0000 7fb0af59e700 1 Processor -- start 2024-03-18T18:09:05.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 -- start start 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00b6e90 0x7fb0b0142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 0x7fb0b01dec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b014a120 0x7fb0b0139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01dc1e0 con 0x7fb0b00bc780 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01dbbc0 con 0x7fb0b014a120 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b01431e0 con 0x7fb0b00b6e90 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 0x7fb0b01dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 0x7fb0b01dec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45080/0 (socket says 172.21.15.94:45080) 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 -- 172.21.15.94:0/2264920196 learned_addr learned my addr 172.21.15.94:0/2264920196 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:05.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0ae59c700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00b6e90 0x7fb0b0142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0aed9d700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b014a120 0x7fb0b0139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 -- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00b6e90 msgr2=0x7fb0b0142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00b6e90 0x7fb0b0142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 -- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b014a120 msgr2=0x7fb0b0139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b014a120 0x7fb0b0139ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 -- 172.21.15.94:0/2264920196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a0009a70 con 0x7fb0b00bc780 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0add9b700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 0x7fb0b01dec50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c500 tx=0x7fb0a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4005d90 con 0x7fb0b00bc780 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a40070d0 con 0x7fb0b00bc780 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0144260 con 0x7fb0b00bc780 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007480 con 0x7fb0b00bc780 2024-03-18T18:09:05.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.977+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b01dc650 con 0x7fb0b00bc780 2024-03-18T18:09:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.981+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b0067620 con 0x7fb0b00bc780 2024-03-18T18:09:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.981+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb0a40075e0 con 0x7fb0b00bc780 2024-03-18T18:09:05.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.981+0000 7fb09effd700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb090066730 0x7fb090068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.981+0000 7fb0ae59c700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb090066730 0x7fb090068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.981+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0a4083110 con 0x7fb0b00bc780 2024-03-18T18:09:05.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.981+0000 7fb0ae59c700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb090066730 0x7fb090068bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0014040 tx=0x7fb0a001d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:05.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:05.989+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb0a40507e0 con 0x7fb0b00bc780 2024-03-18T18:09:06.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.157+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b01dc320 con 0x7fb0b00bc780 2024-03-18T18:09:06.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.157+0000 7fb09effd700 1 -- 172.21.15.94:0/2264920196 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12383 (secure 0 0 0) 0x7fb0b01dc320 con 0x7fb0b00bc780 2024-03-18T18:09:06.161 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:06.161 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:01.890484+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb090066730 msgr2=0x7fb090068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb090066730 0x7fb090068bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0014040 tx=0x7fb0a001d040 comp rx=0 tx=0).stop 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 msgr2=0x7fb0b01dec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 0x7fb0b01dec50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c500 tx=0x7fb0a400c8c0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 shutdown_connections 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fb090066730 0x7fb090068bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b014a120 0x7fb0b0139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0b00bc780 0x7fb0b01dec50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 --2- 172.21.15.94:0/2264920196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b00b6e90 0x7fb0b0142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 >> 172.21.15.94:0/2264920196 conn(0x7fb0b0073600 msgr2=0x7fb0b0146560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:06.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 shutdown_connections 2024-03-18T18:09:06.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.161+0000 7fb0af59e700 1 -- 172.21.15.94:0/2264920196 wait complete. 2024-03-18T18:09:06.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T18:08:58.619045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T18:09:06.180 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T18:09:06.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.297+0000 7fae01121700 1 Processor -- start 2024-03-18T18:09:06.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.297+0000 7fae01121700 1 -- start start 2024-03-18T18:09:06.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 0x7fadfc0b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fadfc1432b0 0x7fadfc143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc072170 con 0x7fadfc146820 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc0b1600 con 0x7fadfc1432b0 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc13da50 con 0x7fadfc071d90 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae00920700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fadfc146820 0x7fadfc146c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46586/0 (socket says 172.21.15.94:46586) 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae00920700 1 -- 172.21.15.94:0/2285427493 learned_addr learned my addr 172.21.15.94:0/2285427493 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfbfff700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 0x7fadfc0b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/2285427493 >> v2:172.21.15.151:3300/0 conn(0x7fadfc1432b0 0x7fadfc143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255595968 0 0) 0x7fadfc072170 con 0x7fadfc146820 2024-03-18T18:09:06.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade80035d0 con 0x7fadfc146820 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510006424 0 0) 0x7fade80035d0 con 0x7fadfc146820 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 msgr2=0x7fadfc0b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 0x7fadfc0b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 >> v2:172.21.15.151:3300/0 conn(0x7fadfc1432b0 msgr2=0x7fadfc143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 --2- 172.21.15.94:0/2285427493 >> v2:172.21.15.151:3300/0 conn(0x7fadfc1432b0 0x7fadfc143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0b1a90 con 0x7fadfc146820 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7fadf40019f0 con 0x7fadfc146820 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 >> v1:172.21.15.94:6789/0 conn(0x7fadfc146820 legacy=0x7fadfc146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 0x7fade8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fade8003fa0 0x7fade8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fade8004db0 0x7fade8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0b1600 con 0x7fade8003fa0 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc13da50 con 0x7fade8004db0 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade800bb10 con 0x7fadfc071d90 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fade8003fa0 0x7fade8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfbfff700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 0x7fade8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae00920700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fade8004db0 0x7fade8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 -- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 msgr2=0x7fade8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadfc071d90 0x7fade8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 -- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fade8004db0 msgr2=0x7fade8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fade8004db0 0x7fade8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 -- 172.21.15.94:0/2285427493 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80035d0 con 0x7fade8003fa0 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fade8003fa0 0x7fade8004870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fadec009b70 tx=0x7fade80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058f8e56118d974 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00e6c0 con 0x7fade8003fa0 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00e820 con 0x7fade8003fa0 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fadfaffd700 1 -- 172.21.15.94:0/2285427493 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00eb90 con 0x7fade8003fa0 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- 172.21.15.94:0/2285427493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fade8003fa0 msgr2=0x7fade8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 --2- 172.21.15.94:0/2285427493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fade8003fa0 0x7fade8004870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fadec009b70 tx=0x7fade80058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae00920700 1 -- 172.21.15.94:0/2285427493 reap_dead start 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- 172.21.15.94:0/2285427493 shutdown_connections 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- 172.21.15.94:0/2285427493 >> 172.21.15.94:0/2285427493 conn(0x7fadfc06a780 msgr2=0x7fadfc0b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- 172.21.15.94:0/2285427493 shutdown_connections 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.301+0000 7fae01121700 1 -- 172.21.15.94:0/2285427493 wait complete. 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 Processor -- start 2024-03-18T18:09:06.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 -- start start 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fade8003fa0 0x7fadfc1d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 0x7fadfc13dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadfc13e160 0x7fadfc137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc1dcf80 con 0x7fadfc1d94e0 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc13f150 con 0x7fadfc13e160 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc13e5e0 con 0x7fade8003fa0 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 0x7fadfc13dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 0x7fadfc13dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45102/0 (socket says 172.21.15.94:45102) 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 -- 172.21.15.94:0/1482711620 learned_addr learned my addr 172.21.15.94:0/1482711620 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae00920700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadfc13e160 0x7fadfc137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfbfff700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fade8003fa0 0x7fadfc1d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 -- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fade8003fa0 msgr2=0x7fadfc1d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fade8003fa0 0x7fadfc1d8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 -- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadfc13e160 msgr2=0x7fadfc137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadfc13e160 0x7fadfc137860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 -- 172.21.15.94:0/1482711620 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc1dd3a0 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae00920700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadfc13e160 0x7fadfc137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadfb7fe700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 0x7fadfc13dc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fadec00e4b0 tx=0x7fadec0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00e6c0 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec013e70 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc1dcba0 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec004270 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.305+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc144750 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.309+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc1dcd30 con 0x7fadfc1d94e0 2024-03-18T18:09:06.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.309+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fadec0043d0 con 0x7fadfc1d94e0 2024-03-18T18:09:06.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.309+0000 7fadf8ff9700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7faddc066760 0x7faddc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.309+0000 7fadfbfff700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7faddc066760 0x7faddc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.309+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fadec0854f0 con 0x7fadfc1d94e0 2024-03-18T18:09:06.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.309+0000 7fadfbfff700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7faddc066760 0x7faddc068c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fade4009ad0 tx=0x7fade4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:06.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.317+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fadec052c40 con 0x7fadfc1d94e0 2024-03-18T18:09:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadfc1dc9d0 con 0x7fadfc1d94e0 2024-03-18T18:09:06.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fadf8ff9700 1 -- 172.21.15.94:0/1482711620 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadec056260 con 0x7fadfc1d94e0 2024-03-18T18:09:06.487 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-03-18T18:09:06.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7faddc066760 msgr2=0x7faddc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7faddc066760 0x7faddc068c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fade4009ad0 tx=0x7fade4008040 comp rx=0 tx=0).stop 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 msgr2=0x7fadfc13dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 0x7fadfc13dc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fadec00e4b0 tx=0x7fadec0047e0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 shutdown_connections 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7faddc066760 0x7faddc068c20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadfc13e160 0x7fadfc137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fadfc1d94e0 0x7fadfc13dc20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 --2- 172.21.15.94:0/1482711620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fade8003fa0 0x7fadfc1d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 >> 172.21.15.94:0/1482711620 conn(0x7fadfc06a780 msgr2=0x7fadfc0b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 shutdown_connections 2024-03-18T18:09:06.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.485+0000 7fae01121700 1 -- 172.21.15.94:0/1482711620 wait complete. 2024-03-18T18:09:06.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:09:06.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 Processor -- start 2024-03-18T18:09:06.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 -- start start 2024-03-18T18:09:06.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd6f00b13a0 0x7fd6f0144300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0070560 con 0x7fd6f0144840 2024-03-18T18:09:06.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00b3790 con 0x7fd6f00b13a0 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ef59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00b1780 con 0x7fd6f014cbf0 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6edd9b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd6f0144840 0x7fd6f013e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46594/0 (socket says 172.21.15.94:46594) 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6edd9b700 1 -- 172.21.15.94:0/2586681910 learned_addr learned my addr 172.21.15.94:0/2586681910 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/2586681910 >> v2:172.21.15.94:3300/0 conn(0x7fd6f00b13a0 0x7fd6f0144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6eed9d700 1 --2- 172.21.15.94:0/2586681910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ed59a700 1 -- 172.21.15.94:0/2586681910 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274762352 0 0) 0x7fd6f0070560 con 0x7fd6f0144840 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ed59a700 1 -- 172.21.15.94:0/2586681910 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d80035d0 con 0x7fd6f0144840 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ee59c700 1 -- 172.21.15.94:0/2586681910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 msgr2=0x7fd6f014efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/2586681910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f014efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ee59c700 1 -- 172.21.15.94:0/2586681910 >> v1:172.21.15.94:6789/0 conn(0x7fd6f0144840 legacy=0x7fd6f013e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ee59c700 1 -- 172.21.15.94:0/2586681910 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00b3a30 con 0x7fd6f00b13a0 2024-03-18T18:09:06.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.609+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/2586681910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f00b13a0 0x7fd6f0144300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009850 tx=0x7fd6e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc18b642246bd6eb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ed59a700 1 -- 172.21.15.94:0/2586681910 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011830 con 0x7fd6f00b13a0 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ed59a700 1 -- 172.21.15.94:0/2586681910 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4011990 con 0x7fd6f00b13a0 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ed59a700 1 -- 172.21.15.94:0/2586681910 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011d40 con 0x7fd6f00b13a0 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- 172.21.15.94:0/2586681910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f00b13a0 msgr2=0x7fd6f0144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/2586681910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f00b13a0 0x7fd6f0144300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009850 tx=0x7fd6e4009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- 172.21.15.94:0/2586681910 shutdown_connections 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/2586681910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f014efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/2586681910 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f00b13a0 0x7fd6f0144300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- 172.21.15.94:0/2586681910 >> 172.21.15.94:0/2586681910 conn(0x7fd6f00b7a20 msgr2=0x7fd6f00b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- 172.21.15.94:0/2586681910 shutdown_connections 2024-03-18T18:09:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- 172.21.15.94:0/2586681910 wait complete. 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 Processor -- start 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- start start 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f00b13a0 0x7fd6f00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 0x7fd6f01435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f0142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f013fb20 con 0x7fd6f0144840 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0134da0 con 0x7fd6f00b13a0 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6ef59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f01dd650 con 0x7fd6f014cbf0 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6edd9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 0x7fd6f01435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6edd9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 0x7fd6f01435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45118/0 (socket says 172.21.15.94:45118) 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.613+0000 7fd6edd9b700 1 -- 172.21.15.94:0/3856863485 learned_addr learned my addr 172.21.15.94:0/3856863485 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f00b13a0 0x7fd6f00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6eed9d700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f0142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6edd9b700 1 -- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 msgr2=0x7fd6f0142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6edd9b700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f0142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6edd9b700 1 -- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f00b13a0 msgr2=0x7fd6f00b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6edd9b700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f00b13a0 0x7fd6f00b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6edd9b700 1 -- 172.21.15.94:0/3856863485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40094b0 con 0x7fd6f0144840 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f00b13a0 0x7fd6f00b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6edd9b700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 0x7fd6f01435e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000cbb0 tx=0x7fd6e000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e000a9e0 con 0x7fd6f0144840 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e000ab40 con 0x7fd6f0144840 2024-03-18T18:09:06.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f01dcb70 con 0x7fd6f0144840 2024-03-18T18:09:06.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0012400 con 0x7fd6f0144840 2024-03-18T18:09:06.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f01dd130 con 0x7fd6f0144840 2024-03-18T18:09:06.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f006fd70 con 0x7fd6f0144840 2024-03-18T18:09:06.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd6e0012560 con 0x7fd6f0144840 2024-03-18T18:09:06.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.617+0000 7fd6deffd700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6d0066730 0x7fd6d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:06.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.621+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6d0066730 0x7fd6d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:06.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.621+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6e0083fd0 con 0x7fd6f0144840 2024-03-18T18:09:06.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.621+0000 7fd6ee59c700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6d0066730 0x7fd6d0068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:06.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.625+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd6e0051820 con 0x7fd6f0144840 2024-03-18T18:09:06.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.829+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f00b76f0 con 0x7fd6f0144840 2024-03-18T18:09:06.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.829+0000 7fd6deffd700 1 -- 172.21.15.94:0/3856863485 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fd6e0021500 con 0x7fd6f0144840 2024-03-18T18:09:06.832 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:06.832 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6d0066730 msgr2=0x7fd6d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6d0066730 0x7fd6d0068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4008030 comp rx=0 tx=0).stop 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 msgr2=0x7fd6f01435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 0x7fd6f01435e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000cbb0 tx=0x7fd6e000cc90 comp rx=0 tx=0).stop 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 shutdown_connections 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6d0066730 0x7fd6d0068bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f014cbf0 0x7fd6f0142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6f0144840 0x7fd6f01435e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 --2- 172.21.15.94:0/3856863485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f00b13a0 0x7fd6f00b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 >> 172.21.15.94:0/3856863485 conn(0x7fd6f00b7a20 msgr2=0x7fd6f0137d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 shutdown_connections 2024-03-18T18:09:06.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:06.833+0000 7fd6ef59e700 1 -- 172.21.15.94:0/3856863485 wait complete. 2024-03-18T18:09:06.836 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 2 2024-03-18T18:09:08.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:09:08.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 Processor -- start 2024-03-18T18:09:08.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 -- start start 2024-03-18T18:09:08.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f79b814e0a0 0x7f79b80afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:08.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b80b2420 0x7f79b8144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:08.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80af790 con 0x7f79b80b1000 2024-03-18T18:09:08.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80af210 con 0x7f79b814e0a0 2024-03-18T18:09:08.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b7fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b806e700 con 0x7f79b80b2420 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b6ffd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f79b814e0a0 0x7f79b80afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b67fc700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f79b80b1000 0x7f79b814e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46602/0 (socket says 172.21.15.94:46602) 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b67fc700 1 -- 172.21.15.94:0/1232463729 learned_addr learned my addr 172.21.15.94:0/1232463729 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b77fe700 1 --2- 172.21.15.94:0/1232463729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b80b2420 0x7f79b8144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b5ffb700 1 -- 172.21.15.94:0/1232463729 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750763401 0 0) 0x7f79b80af790 con 0x7f79b80b1000 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b5ffb700 1 -- 172.21.15.94:0/1232463729 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a40035d0 con 0x7f79b80b1000 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b6ffd700 1 -- 172.21.15.94:0/1232463729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b80b2420 msgr2=0x7f79b8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b6ffd700 1 --2- 172.21.15.94:0/1232463729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b80b2420 0x7f79b8144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b6ffd700 1 -- 172.21.15.94:0/1232463729 >> v1:172.21.15.94:6789/0 conn(0x7f79b80b1000 legacy=0x7f79b814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b5ffb700 1 -- 172.21.15.94:0/1232463729 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2587299432 0 0) 0x7f79a40035d0 con 0x7f79b80b1000 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b6ffd700 1 -- 172.21.15.94:0/1232463729 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b80b0160 con 0x7f79b814e0a0 2024-03-18T18:09:08.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b6ffd700 1 --2- 172.21.15.94:0/1232463729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b80afc20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009850 tx=0x7f79a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596c06bda0ae8f3f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:08.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b5ffb700 1 -- 172.21.15.94:0/1232463729 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8001670 con 0x7f79b814e0a0 2024-03-18T18:09:08.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b5ffb700 1 -- 172.21.15.94:0/1232463729 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0004030 con 0x7f79b814e0a0 2024-03-18T18:09:08.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.969+0000 7f79b5ffb700 1 -- 172.21.15.94:0/1232463729 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00043e0 con 0x7f79b814e0a0 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- 172.21.15.94:0/1232463729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 msgr2=0x7f79b80afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 --2- 172.21.15.94:0/1232463729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b80afc20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009850 tx=0x7f79a0009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- 172.21.15.94:0/1232463729 shutdown_connections 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 --2- 172.21.15.94:0/1232463729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b80b2420 0x7f79b8144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 --2- 172.21.15.94:0/1232463729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b80afc20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- 172.21.15.94:0/1232463729 >> 172.21.15.94:0/1232463729 conn(0x7f79b80b7a20 msgr2=0x7f79b80b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- 172.21.15.94:0/1232463729 shutdown_connections 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- 172.21.15.94:0/1232463729 wait complete. 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 Processor -- start 2024-03-18T18:09:08.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- start start 2024-03-18T18:09:08.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b80b2420 0x7f79b813cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:08.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b8145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:08.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b813d7f0 0x7f79b81e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:08.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b81474a0 con 0x7f79b814e0a0 2024-03-18T18:09:08.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b813fdb0 con 0x7f79b80b2420 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b81481b0 con 0x7f79b813d7f0 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b8145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b8145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45140/0 (socket says 172.21.15.94:45140) 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 -- 172.21.15.94:0/3293223037 learned_addr learned my addr 172.21.15.94:0/3293223037 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b77fe700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b813d7f0 0x7f79b81e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b6ffd700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b80b2420 0x7f79b813cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 -- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b813d7f0 msgr2=0x7f79b81e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b813d7f0 0x7f79b81e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 -- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b80b2420 msgr2=0x7f79b813cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b80b2420 0x7f79b813cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 -- 172.21.15.94:0/3293223037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00094b0 con 0x7f79b814e0a0 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b67fc700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b8145330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c700 tx=0x7f79a800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8004ca0 con 0x7f79b814e0a0 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8004e00 con 0x7f79b814e0a0 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.973+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b81476d0 con 0x7f79b814e0a0 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8007310 con 0x7f79b814e0a0 2024-03-18T18:09:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b8147c90 con 0x7f79b814e0a0 2024-03-18T18:09:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b80b4320 con 0x7f79b814e0a0 2024-03-18T18:09:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f79a8007470 con 0x7f79b814e0a0 2024-03-18T18:09:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79af7fe700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7998066760 0x7f7998068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79a8083a80 con 0x7f79b814e0a0 2024-03-18T18:09:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79b6ffd700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7998066760 0x7f7998068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.977+0000 7f79b6ffd700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7998066760 0x7f7998068c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79a00090b0 tx=0x7f79a0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:08.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:08.985+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f79a8051140 con 0x7f79b814e0a0 2024-03-18T18:09:09.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.193+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79b80b1780 con 0x7f79b814e0a0 2024-03-18T18:09:09.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.193+0000 7f79af7fe700 1 -- 172.21.15.94:0/3293223037 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2006 (secure 0 0 0) 0x7f79a8007720 con 0x7f79b814e0a0 2024-03-18T18:09:09.195 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:09.195 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-03-18T18:09:09.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7998066760 msgr2=0x7f7998068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7998066760 0x7f7998068c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79a00090b0 tx=0x7f79a0008030 comp rx=0 tx=0).stop 2024-03-18T18:09:09.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 msgr2=0x7f79b8145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b8145330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c700 tx=0x7f79a800ca10 comp rx=0 tx=0).stop 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 shutdown_connections 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7998066760 0x7f7998068c20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79b813d7f0 0x7f79b81e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79b814e0a0 0x7f79b8145330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 --2- 172.21.15.94:0/3293223037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b80b2420 0x7f79b813cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 >> 172.21.15.94:0/3293223037 conn(0x7f79b80b7a20 msgr2=0x7f79b814e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 shutdown_connections 2024-03-18T18:09:09.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.197+0000 7f79b7fff700 1 -- 172.21.15.94:0/3293223037 wait complete. 2024-03-18T18:09:09.201 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 3 2024-03-18T18:09:09.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 Processor -- start 2024-03-18T18:09:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 -- start start 2024-03-18T18:09:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa46c0b13a0 0x7fa46c144300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c14cbf0 0x7fa46c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c070560 con 0x7fa46c144840 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0b3790 con 0x7fa46c0b13a0 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.321+0000 7fa46bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0b1780 con 0x7fa46c14cbf0 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46a7fc700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa46c144840 0x7fa46c13e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46612/0 (socket says 172.21.15.94:46612) 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46a7fc700 1 -- 172.21.15.94:0/3340340933 learned_addr learned my addr 172.21.15.94:0/3340340933 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46affd700 1 --2- 172.21.15.94:0/3340340933 >> v2:172.21.15.94:3300/0 conn(0x7fa46c0b13a0 0x7fa46c144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46b7fe700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c14cbf0 0x7fa46c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa469ffb700 1 -- 172.21.15.94:0/3340340933 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813426058 0 0) 0x7fa46c070560 con 0x7fa46c144840 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa469ffb700 1 -- 172.21.15.94:0/3340340933 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4580035d0 con 0x7fa46c144840 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46affd700 1 -- 172.21.15.94:0/3340340933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c14cbf0 msgr2=0x7fa46c14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46affd700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c14cbf0 0x7fa46c14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46affd700 1 -- 172.21.15.94:0/3340340933 >> v1:172.21.15.94:6789/0 conn(0x7fa46c144840 legacy=0x7fa46c13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46affd700 1 -- 172.21.15.94:0/3340340933 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0b3a30 con 0x7fa46c0b13a0 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46b7fe700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c14cbf0 0x7fa46c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:09.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46affd700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c144300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa454009850 tx=0x7fa454009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6d5f2c1953c5cd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa469ffb700 1 -- 172.21.15.94:0/3340340933 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454011830 con 0x7fa46c0b13a0 2024-03-18T18:09:09.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa469ffb700 1 -- 172.21.15.94:0/3340340933 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454011990 con 0x7fa46c0b13a0 2024-03-18T18:09:09.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa469ffb700 1 -- 172.21.15.94:0/3340340933 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454011d40 con 0x7fa46c0b13a0 2024-03-18T18:09:09.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 -- 172.21.15.94:0/3340340933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 msgr2=0x7fa46c144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c144300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa454009850 tx=0x7fa454009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 -- 172.21.15.94:0/3340340933 shutdown_connections 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c14cbf0 0x7fa46c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 --2- 172.21.15.94:0/3340340933 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c144300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 -- 172.21.15.94:0/3340340933 >> 172.21.15.94:0/3340340933 conn(0x7fa46c0b7a20 msgr2=0x7fa46c0b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 -- 172.21.15.94:0/3340340933 shutdown_connections 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 -- 172.21.15.94:0/3340340933 wait complete. 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 Processor -- start 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.325+0000 7fa46bfff700 1 -- start start 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c144840 0x7fa46c1dc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa46c14cbf0 0x7fa46c137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c13f240 con 0x7fa46c0b13a0 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1441f0 con 0x7fa46c14cbf0 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1db880 con 0x7fa46c144840 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c142760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45152/0 (socket says 172.21.15.94:45152) 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 -- 172.21.15.94:0/4076571674 learned_addr learned my addr 172.21.15.94:0/4076571674 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46a7fc700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c144840 0x7fa46c1dc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46b7fe700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa46c14cbf0 0x7fa46c137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 -- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c144840 msgr2=0x7fa46c1dc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c144840 0x7fa46c1dc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 -- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa46c14cbf0 msgr2=0x7fa46c137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa46c14cbf0 0x7fa46c137be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 -- 172.21.15.94:0/4076571674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4540094b0 con 0x7fa46c0b13a0 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46affd700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c142760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4540090b0 tx=0x7fa454004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540036c0 con 0x7fa46c0b13a0 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45401f070 con 0x7fa46c0b13a0 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c1dbb60 con 0x7fa46c0b13a0 2024-03-18T18:09:09.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454003a60 con 0x7fa46c0b13a0 2024-03-18T18:09:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c0b0760 con 0x7fa46c0b13a0 2024-03-18T18:09:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.329+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c06fd70 con 0x7fa46c0b13a0 2024-03-18T18:09:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.333+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa454003bc0 con 0x7fa46c0b13a0 2024-03-18T18:09:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.333+0000 7fa4637fe700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa44c066730 0x7fa44c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.333+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa454021070 con 0x7fa46c0b13a0 2024-03-18T18:09:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.333+0000 7fa46a7fc700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa44c066730 0x7fa44c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.333+0000 7fa46a7fc700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa44c066730 0x7fa44c068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa46c13de90 tx=0x7fa464000f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.341+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa454052ce0 con 0x7fa46c0b13a0 2024-03-18T18:09:09.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.509+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa46c06f1f0 con 0x7fa46c0b13a0 2024-03-18T18:09:09.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.509+0000 7fa4637fe700 1 -- 172.21.15.94:0/4076571674 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12383 (secure 0 0 0) 0x7fa46c06f1f0 con 0x7fa46c0b13a0 2024-03-18T18:09:09.512 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:09.513 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":18,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:01.890484+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:09.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa44c066730 msgr2=0x7fa44c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa44c066730 0x7fa44c068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa46c13de90 tx=0x7fa464000f40 comp rx=0 tx=0).stop 2024-03-18T18:09:09.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 msgr2=0x7fa46c142760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c142760 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4540090b0 tx=0x7fa454004770 comp rx=0 tx=0).stop 2024-03-18T18:09:09.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 shutdown_connections 2024-03-18T18:09:09.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa44c066730 0x7fa44c068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa46c14cbf0 0x7fa46c137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa46c144840 0x7fa46c1dc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 --2- 172.21.15.94:0/4076571674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa46c0b13a0 0x7fa46c142760 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 >> 172.21.15.94:0/4076571674 conn(0x7fa46c0b7a20 msgr2=0x7fa46c139b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:09.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 shutdown_connections 2024-03-18T18:09:09.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.513+0000 7fa46bfff700 1 -- 172.21.15.94:0/4076571674 wait complete. 2024-03-18T18:09:09.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T18:08:58.619045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T18:09:09.527 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T18:09:09.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.637+0000 7f10d6abc700 1 Processor -- start 2024-03-18T18:09:09.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.637+0000 7f10d6abc700 1 -- start start 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f10d0071960 0x7f10d0071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d014f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d0072350 con 0x7f10d00b8480 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d00b1eb0 con 0x7f10d0071960 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00b2500 con 0x7f10d014cc50 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d5aba700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f10d00b8480 0x7f10d0144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46628/0 (socket says 172.21.15.94:46628) 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d5aba700 1 -- 172.21.15.94:0/85667313 learned_addr learned my addr 172.21.15.94:0/85667313 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d62bb700 1 --2- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d52b9700 1 --2- 172.21.15.94:0/85667313 >> v2:172.21.15.151:3300/0 conn(0x7f10d0071960 0x7f10d0071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d4ab8700 1 -- 172.21.15.94:0/85667313 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013824349 0 0) 0x7f10d0072350 con 0x7f10d00b8480 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d4ab8700 1 -- 172.21.15.94:0/85667313 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b80035d0 con 0x7f10d00b8480 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d52b9700 1 -- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 msgr2=0x7f10d014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d52b9700 1 --2- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d52b9700 1 -- 172.21.15.94:0/85667313 >> v1:172.21.15.94:6789/0 conn(0x7f10d00b8480 legacy=0x7f10d0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d52b9700 1 -- 172.21.15.94:0/85667313 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d006ed90 con 0x7f10d0071960 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d52b9700 1 --2- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d0071e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009d90 tx=0x7f10c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d87eab4d66499b76 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d4ab8700 1 -- 172.21.15.94:0/85667313 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c000e070 con 0x7f10d0071960 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d4ab8700 1 -- 172.21.15.94:0/85667313 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c000bb20 con 0x7f10d0071960 2024-03-18T18:09:09.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d4ab8700 1 -- 172.21.15.94:0/85667313 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0012430 con 0x7f10d0071960 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 msgr2=0x7f10d0071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 --2- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d0071e10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009d90 tx=0x7f10c000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- 172.21.15.94:0/85667313 shutdown_connections 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 --2- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 --2- 172.21.15.94:0/85667313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d0071e10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- 172.21.15.94:0/85667313 >> 172.21.15.94:0/85667313 conn(0x7f10d006a780 msgr2=0x7f10d00b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- 172.21.15.94:0/85667313 shutdown_connections 2024-03-18T18:09:09.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.641+0000 7f10d6abc700 1 -- 172.21.15.94:0/85667313 wait complete. 2024-03-18T18:09:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 Processor -- start 2024-03-18T18:09:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 -- start start 2024-03-18T18:09:09.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d01da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 0x7f10d01408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d00ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01d9aa0 con 0x7f10d00b8480 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01d9d80 con 0x7f10d0071960 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d6abc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d01d9750 con 0x7f10d014cc50 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 0x7f10d01408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 0x7f10d01408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45168/0 (socket says 172.21.15.94:45168) 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 -- 172.21.15.94:0/2911689835 learned_addr learned my addr 172.21.15.94:0/2911689835 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d5aba700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d01da2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d62bb700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d00ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 -- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 msgr2=0x7f10d00ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d00ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 -- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 msgr2=0x7f10d01da2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d01da2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 -- 172.21.15.94:0/2911689835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0009a70 con 0x7f10d00b8480 2024-03-18T18:09:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.645+0000 7f10d52b9700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 0x7f10d01408d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f10c0014040 tx=0x7f10c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0012430 con 0x7f10d00b8480 2024-03-18T18:09:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0020070 con 0x7f10d00b8480 2024-03-18T18:09:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d01413b0 con 0x7f10d00b8480 2024-03-18T18:09:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0004280 con 0x7f10d00b8480 2024-03-18T18:09:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d01dccc0 con 0x7f10d00b8480 2024-03-18T18:09:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d00ab6a0 con 0x7f10d00b8480 2024-03-18T18:09:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f10c00043e0 con 0x7f10d00b8480 2024-03-18T18:09:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10ce7fc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f10bc066730 0x7f10bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10d5aba700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f10bc066730 0x7f10bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10c0022070 con 0x7f10d00b8480 2024-03-18T18:09:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.649+0000 7f10d5aba700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f10bc066730 0x7f10bc068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10c4007fd0 tx=0x7f10c4007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.657+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f10c0053340 con 0x7f10d00b8480 2024-03-18T18:09:09.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.825+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10d014cac0 con 0x7f10d00b8480 2024-03-18T18:09:09.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.825+0000 7f10ce7fc700 1 -- 172.21.15.94:0/2911689835 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10c0056960 con 0x7f10d00b8480 2024-03-18T18:09:09.828 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f10bc066730 msgr2=0x7f10bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f10bc066730 0x7f10bc068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10c4007fd0 tx=0x7f10c4007de0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 msgr2=0x7f10d01408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 0x7f10d01408d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f10c0014040 tx=0x7f10c0004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 shutdown_connections 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f10bc066730 0x7f10bc068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10d014cc50 0x7f10d00ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d00b8480 0x7f10d01408d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 --2- 172.21.15.94:0/2911689835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10d0071960 0x7f10d01da2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 >> 172.21.15.94:0/2911689835 conn(0x7f10d006a780 msgr2=0x7f10d00b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:09.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 shutdown_connections 2024-03-18T18:09:09.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.829+0000 7f10d6abc700 1 -- 172.21.15.94:0/2911689835 wait complete. 2024-03-18T18:09:09.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-18T18:09:09.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47b59e700 1 Processor -- start 2024-03-18T18:09:09.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47b59e700 1 -- start start 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5490 0x7fd47c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47b59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c070770 con 0x7fd47c06f840 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47b59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c06fca0 con 0x7fd47c0b5e90 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0aff50 con 0x7fd47c0b5490 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47ad9d700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd47c06f840 0x7fd47c14dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46636/0 (socket says 172.21.15.94:46636) 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47ad9d700 1 -- 172.21.15.94:0/447485583 learned_addr learned my addr 172.21.15.94:0/447485583 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:09.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd479d9b700 1 --2- 172.21.15.94:0/447485583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5490 0x7fd47c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47959a700 1 -- 172.21.15.94:0/447485583 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485878951 0 0) 0x7fd47c070770 con 0x7fd47c06f840 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd47959a700 1 -- 172.21.15.94:0/447485583 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4640035d0 con 0x7fd47c06f840 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd479d9b700 1 -- 172.21.15.94:0/447485583 >> v1:172.21.15.151:6789/0 conn(0x7fd47c0b5e90 legacy=0x7fd47c13d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd479d9b700 1 -- 172.21.15.94:0/447485583 >> v1:172.21.15.94:6789/0 conn(0x7fd47c06f840 legacy=0x7fd47c14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.949+0000 7fd479d9b700 1 -- 172.21.15.94:0/447485583 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c070440 con 0x7fd47c0b5490 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd479d9b700 1 --2- 172.21.15.94:0/447485583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5490 0x7fd47c070c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009880 tx=0x7fd46c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4b22c6c083f7578 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47959a700 1 -- 172.21.15.94:0/447485583 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011830 con 0x7fd47c0b5490 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47959a700 1 -- 172.21.15.94:0/447485583 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c011990 con 0x7fd47c0b5490 2024-03-18T18:09:09.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47959a700 1 -- 172.21.15.94:0/447485583 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011d20 con 0x7fd47c0b5490 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 -- 172.21.15.94:0/447485583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5490 msgr2=0x7fd47c070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 --2- 172.21.15.94:0/447485583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5490 0x7fd47c070c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009880 tx=0x7fd46c009b90 comp rx=0 tx=0).stop 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 -- 172.21.15.94:0/447485583 shutdown_connections 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 --2- 172.21.15.94:0/447485583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5490 0x7fd47c070c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 -- 172.21.15.94:0/447485583 >> 172.21.15.94:0/447485583 conn(0x7fd47c06ba30 msgr2=0x7fd47c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 -- 172.21.15.94:0/447485583 shutdown_connections 2024-03-18T18:09:09.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 -- 172.21.15.94:0/447485583 wait complete. 2024-03-18T18:09:09.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 Processor -- start 2024-03-18T18:09:09.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.953+0000 7fd47b59e700 1 -- start start 2024-03-18T18:09:09.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 0x7fd47c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd47c0b5490 0x7fd47c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5e90 0x7fd47c1d6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c13f660 con 0x7fd47c06f840 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1405d0 con 0x7fd47c0b5490 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c13fa80 con 0x7fd47c0b5e90 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 0x7fd47c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 0x7fd47c0af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45184/0 (socket says 172.21.15.94:45184) 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 -- 172.21.15.94:0/1211812275 learned_addr learned my addr 172.21.15.94:0/1211812275 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47ad9d700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5e90 0x7fd47c1d6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd479d9b700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd47c0b5490 0x7fd47c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 -- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5e90 msgr2=0x7fd47c1d6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5e90 0x7fd47c1d6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 -- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd47c0b5490 msgr2=0x7fd47c0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd47c0b5490 0x7fd47c0b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 -- 172.21.15.94:0/1211812275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0094b0 con 0x7fd47c06f840 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47a59c700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 0x7fd47c0af1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c500 tx=0x7fd47000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700052d0 con 0x7fd47c06f840 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470005430 con 0x7fd47c06f840 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c1381c0 con 0x7fd47c06f840 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700055a0 con 0x7fd47c06f840 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c1407d0 con 0x7fd47c06f840 2024-03-18T18:09:09.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.957+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c13f7a0 con 0x7fd47c06f840 2024-03-18T18:09:09.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.961+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd4700038e0 con 0x7fd47c06f840 2024-03-18T18:09:09.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.961+0000 7fd46affd700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd45c066760 0x7fd45c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:09.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.961+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd4700830c0 con 0x7fd47c06f840 2024-03-18T18:09:09.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.961+0000 7fd479d9b700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd45c066760 0x7fd45c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:09.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.961+0000 7fd479d9b700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd45c066760 0x7fd45c068c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0090b0 tx=0x7fd46c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:09.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:09.965+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd47c13f7a0 con 0x7fd47c06f840 2024-03-18T18:09:10.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.137+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd47c13f7a0 con 0x7fd47c06f840 2024-03-18T18:09:10.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.137+0000 7fd46affd700 1 -- 172.21.15.94:0/1211812275 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd47c13f7a0 con 0x7fd47c06f840 2024-03-18T18:09:10.141 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:10.142 INFO:teuthology.orchestra.run.smithi094.stdout:[ 2024-03-18T18:09:10.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:09:10.142 INFO:teuthology.orchestra.run.smithi094.stdout: "poolnum": 1, 2024-03-18T18:09:10.142 INFO:teuthology.orchestra.run.smithi094.stdout: "poolname": ".mgr" 2024-03-18T18:09:10.142 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:09:10.142 INFO:teuthology.orchestra.run.smithi094.stdout:] 2024-03-18T18:09:10.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd45c066760 msgr2=0x7fd45c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:10.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd45c066760 0x7fd45c068c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0090b0 tx=0x7fd46c010000 comp rx=0 tx=0).stop 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 msgr2=0x7fd47c0af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 0x7fd47c0af1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd47000c500 tx=0x7fd47000c810 comp rx=0 tx=0).stop 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 shutdown_connections 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd45c066760 0x7fd45c068c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd47c0b5e90 0x7fd47c1d6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd47c0b5490 0x7fd47c0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 --2- 172.21.15.94:0/1211812275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd47c06f840 0x7fd47c0af1d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 >> 172.21.15.94:0/1211812275 conn(0x7fd47c06ba30 msgr2=0x7fd47c141430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 shutdown_connections 2024-03-18T18:09:10.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.141+0000 7fd47b59e700 1 -- 172.21.15.94:0/1211812275 wait complete. 2024-03-18T18:09:10.161 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-18T18:09:10.161 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-18T18:09:10.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.273+0000 7fd34359e700 1 Processor -- start 2024-03-18T18:09:10.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.273+0000 7fd34359e700 1 -- start start 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd344146f70 0x7fd3440710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440715e0 0x7fd344150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd344146ae0 con 0x7fd3440b6cf0 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34406bb90 con 0x7fd344146f70 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34406d720 con 0x7fd3440715e0 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd344146f70 0x7fd3440710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd344146f70 0x7fd3440710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45200/0 (socket says 172.21.15.94:45200) 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 -- 172.21.15.94:0/550756816 learned_addr learned my addr 172.21.15.94:0/550756816 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd342d9d700 1 --2- 172.21.15.94:0/550756816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440715e0 0x7fd344150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 -- 172.21.15.94:0/550756816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440715e0 msgr2=0x7fd344150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 --2- 172.21.15.94:0/550756816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440715e0 0x7fd344150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 -- 172.21.15.94:0/550756816 >> v1:172.21.15.151:6789/0 conn(0x7fd3440b6cf0 legacy=0x7fd34406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 -- 172.21.15.94:0/550756816 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440b0e60 con 0x7fd344146f70 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd339d9b700 1 --2- 172.21.15.94:0/550756816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd3440710a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009910 tx=0x7fd32c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d29b64de6594e2c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd341d9b700 1 -- 172.21.15.94:0/550756816 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c00ba60 con 0x7fd344146f70 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd341d9b700 1 -- 172.21.15.94:0/550756816 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c00bbc0 con 0x7fd344146f70 2024-03-18T18:09:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd341d9b700 1 -- 172.21.15.94:0/550756816 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c009e60 con 0x7fd344146f70 2024-03-18T18:09:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- 172.21.15.94:0/550756816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 msgr2=0x7fd3440710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 --2- 172.21.15.94:0/550756816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd3440710a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009910 tx=0x7fd32c009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- 172.21.15.94:0/550756816 shutdown_connections 2024-03-18T18:09:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 --2- 172.21.15.94:0/550756816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440715e0 0x7fd344150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 --2- 172.21.15.94:0/550756816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd3440710a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- 172.21.15.94:0/550756816 >> 172.21.15.94:0/550756816 conn(0x7fd34406a330 msgr2=0x7fd34406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- 172.21.15.94:0/550756816 shutdown_connections 2024-03-18T18:09:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.277+0000 7fd34359e700 1 -- 172.21.15.94:0/550756816 wait complete. 2024-03-18T18:09:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 Processor -- start 2024-03-18T18:09:10.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 -- start start 2024-03-18T18:09:10.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3440715e0 0x7fd344144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:10.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 0x7fd3441df2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:10.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd34413da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:10.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441de8e0 con 0x7fd344146f70 2024-03-18T18:09:10.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441df830 con 0x7fd3440715e0 2024-03-18T18:09:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3441dee60 con 0x7fd3440b6cf0 2024-03-18T18:09:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd339d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 0x7fd3441df2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd342d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd34413da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd339d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 0x7fd3441df2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:45806/0 (socket says 172.21.15.94:45806) 2024-03-18T18:09:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd339d9b700 1 -- 172.21.15.94:0/2922072663 learned_addr learned my addr 172.21.15.94:0/2922072663 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:10.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd34259c700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3440715e0 0x7fd344144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:10.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd342d9d700 1 -- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 msgr2=0x7fd3441df2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:10.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd342d9d700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 0x7fd3441df2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.281+0000 7fd342d9d700 1 -- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3440715e0 msgr2=0x7fd344144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd342d9d700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3440715e0 0x7fd344144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd342d9d700 1 -- 172.21.15.94:0/2922072663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c009570 con 0x7fd344146f70 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd339d9b700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 0x7fd3441df2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd342d9d700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd34413da60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd33c007cf0 tx=0x7fd33c00e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c018070 con 0x7fd344146f70 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c003a40 con 0x7fd344146f70 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3441deaf0 con 0x7fd344146f70 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c003dd0 con 0x7fd344146f70 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3440ae350 con 0x7fd344146f70 2024-03-18T18:09:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3441df010 con 0x7fd344146f70 2024-03-18T18:09:10.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.285+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd33c00e910 con 0x7fd344146f70 2024-03-18T18:09:10.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.289+0000 7fd33b7fe700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd324066730 0x7fd324068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:10.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.289+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd33c083b90 con 0x7fd344146f70 2024-03-18T18:09:10.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.289+0000 7fd34259c700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd324066730 0x7fd324068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:10.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.289+0000 7fd34259c700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd324066730 0x7fd324068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd344143e70 tx=0x7fd334009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:10.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.293+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd3441df010 con 0x7fd344146f70 2024-03-18T18:09:10.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:10.461+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd3441defd0 con 0x7fd344146f70 2024-03-18T18:09:11.209 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:09:11.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:09:11.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.417+0000 7fd33b7fe700 1 -- 172.21.15.94:0/2922072663 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd33c0512e0 con 0x7fd344146f70 2024-03-18T18:09:11.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd324066730 msgr2=0x7fd324068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:11.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd324066730 0x7fd324068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd344143e70 tx=0x7fd334009040 comp rx=0 tx=0).stop 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 msgr2=0x7fd34413da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd34413da60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd33c007cf0 tx=0x7fd33c00e0e0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 shutdown_connections 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd324066730 0x7fd324068bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd344146f70 0x7fd34413da60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3440b6cf0 0x7fd3441df2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 --2- 172.21.15.94:0/2922072663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3440715e0 0x7fd344144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.421+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 >> 172.21.15.94:0/2922072663 conn(0x7fd34406a330 msgr2=0x7fd3440b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.425+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 shutdown_connections 2024-03-18T18:09:11.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.425+0000 7fd34359e700 1 -- 172.21.15.94:0/2922072663 wait complete. 2024-03-18T18:09:11.428 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' created 2024-03-18T18:09:11.442 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-18T18:09:11.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.557+0000 7f1b4ffff700 1 Processor -- start 2024-03-18T18:09:11.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.557+0000 7f1b4ffff700 1 -- start start 2024-03-18T18:09:11.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1b500b8480 0x7f1b50144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:11.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b50145010 0x7f1b50071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:11.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50072350 con 0x7f1b50071ea0 2024-03-18T18:09:11.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b500b1eb0 con 0x7f1b50145010 2024-03-18T18:09:11.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b500b2500 con 0x7f1b500b8480 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b50145010 0x7f1b50071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1b50145010 0x7f1b50071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45228/0 (socket says 172.21.15.94:45228) 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1555994220 learned_addr learned my addr 172.21.15.94:0/1555994220 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4effd700 1 --2- 172.21.15.94:0/1555994220 >> v2:172.21.15.151:3300/0 conn(0x7f1b500b8480 0x7f1b50144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1555994220 >> v2:172.21.15.151:3300/0 conn(0x7f1b500b8480 msgr2=0x7f1b50144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 --2- 172.21.15.94:0/1555994220 >> v2:172.21.15.151:3300/0 conn(0x7f1b500b8480 0x7f1b50144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1555994220 >> v1:172.21.15.94:6789/0 conn(0x7f1b50071ea0 legacy=0x7f1b50147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1555994220 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5006ed90 con 0x7f1b50145010 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4e7fc700 1 --2- 172.21.15.94:0/1555994220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b50145010 0x7f1b50071960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b500b8b30 tx=0x7f1b38009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596eddfe15a687c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4dffb700 1 -- 172.21.15.94:0/1555994220 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800b8a0 con 0x7f1b50145010 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4dffb700 1 -- 172.21.15.94:0/1555994220 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3800ba00 con 0x7f1b50145010 2024-03-18T18:09:11.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4dffb700 1 -- 172.21.15.94:0/1555994220 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800bd90 con 0x7f1b50145010 2024-03-18T18:09:11.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1555994220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b50145010 msgr2=0x7f1b50071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 --2- 172.21.15.94:0/1555994220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b50145010 0x7f1b50071960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b500b8b30 tx=0x7f1b38009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1555994220 shutdown_connections 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 --2- 172.21.15.94:0/1555994220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b50145010 0x7f1b50071960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 --2- 172.21.15.94:0/1555994220 >> v2:172.21.15.151:3300/0 conn(0x7f1b500b8480 0x7f1b50144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1555994220 >> 172.21.15.94:0/1555994220 conn(0x7f1b5006a780 msgr2=0x7f1b500b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1555994220 shutdown_connections 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1555994220 wait complete. 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 Processor -- start 2024-03-18T18:09:11.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.561+0000 7f1b4ffff700 1 -- start start 2024-03-18T18:09:11.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b50071ea0 0x7f1b500a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:11.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 0x7f1b500a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:11.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b50145010 0x7f1b501dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:11.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500a8c90 con 0x7f1b500b8480 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50141bc0 con 0x7f1b50145010 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50139b30 con 0x7f1b50071ea0 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 0x7f1b500a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 0x7f1b500a9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45238/0 (socket says 172.21.15.94:45238) 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1483977118 learned_addr learned my addr 172.21.15.94:0/1483977118 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4f7fe700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b50145010 0x7f1b501dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4effd700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b50071ea0 0x7f1b500a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b50071ea0 msgr2=0x7f1b500a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b50071ea0 0x7f1b500a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b50145010 msgr2=0x7f1b501dcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b50145010 0x7f1b501dcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:11.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 -- 172.21.15.94:0/1483977118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009570 con 0x7f1b500b8480 2024-03-18T18:09:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4e7fc700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 0x7f1b500a9050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380038c0 con 0x7f1b500b8480 2024-03-18T18:09:11.570 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3801e070 con 0x7f1b500b8480 2024-03-18T18:09:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1483977118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500a8ea0 con 0x7f1b500b8480 2024-03-18T18:09:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38003c80 con 0x7f1b500b8480 2024-03-18T18:09:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.565+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1483977118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50140760 con 0x7f1b500b8480 2024-03-18T18:09:11.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.569+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1483977118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50141d30 con 0x7f1b500b8480 2024-03-18T18:09:11.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.569+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1b3801a420 con 0x7f1b500b8480 2024-03-18T18:09:11.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.569+0000 7f1b477fe700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1b30066730 0x7f1b30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:11.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.569+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1b38020070 con 0x7f1b500b8480 2024-03-18T18:09:11.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.569+0000 7f1b4effd700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1b30066730 0x7f1b30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:11.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.573+0000 7f1b4effd700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1b30066730 0x7f1b30068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009a00 tx=0x7f1b40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:11.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.573+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1b38052960 con 0x7f1b500b8480 2024-03-18T18:09:11.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:11.741+0000 7f1b4ffff700 1 -- 172.21.15.94:0/1483977118 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1b50141d30 con 0x7f1b500b8480 2024-03-18T18:09:12.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.421+0000 7f1b477fe700 1 -- 172.21.15.94:0/1483977118 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1b50141d30 con 0x7f1b500b8480 2024-03-18T18:09:12.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 -- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1b30066730 msgr2=0x7f1b30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1b30066730 0x7f1b30068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009a00 tx=0x7f1b40008040 comp rx=0 tx=0).stop 2024-03-18T18:09:12.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 -- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 msgr2=0x7f1b500a9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 0x7f1b500a9050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b38004770 comp rx=0 tx=0).stop 2024-03-18T18:09:12.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 -- 172.21.15.94:0/1483977118 shutdown_connections 2024-03-18T18:09:12.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1b30066730 0x7f1b30068bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.436+0000 7f1b457fa700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b50145010 0x7f1b501dcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.440+0000 7f1b457fa700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b500b8480 0x7f1b500a9050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.440+0000 7f1b457fa700 1 --2- 172.21.15.94:0/1483977118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b50071ea0 0x7f1b500a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.440+0000 7f1b457fa700 1 -- 172.21.15.94:0/1483977118 >> 172.21.15.94:0/1483977118 conn(0x7f1b5006a780 msgr2=0x7f1b50142920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.440+0000 7f1b457fa700 1 -- 172.21.15.94:0/1483977118 shutdown_connections 2024-03-18T18:09:12.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.440+0000 7f1b457fa700 1 -- 172.21.15.94:0/1483977118 wait complete. 2024-03-18T18:09:12.447 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' created 2024-03-18T18:09:12.459 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-18T18:09:12.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.568+0000 7f53c49df700 1 Processor -- start 2024-03-18T18:09:12.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.568+0000 7f53c49df700 1 -- start start 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53c00b6030 0x7f53c006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c00b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53c0140600 0x7f53c0140a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c0072520 con 0x7f53c0140600 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c00b6410 con 0x7f53c00b6030 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0071060 con 0x7f53c00720e0 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53c0140600 0x7f53c0140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f53c0140600 0x7f53c0140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45240/0 (socket says 172.21.15.94:45240) 2024-03-18T18:09:12.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 -- 172.21.15.94:0/1792673216 learned_addr learned my addr 172.21.15.94:0/1792673216 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bdd9b700 1 --2- 172.21.15.94:0/1792673216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c00b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53be59c700 1 --2- 172.21.15.94:0/1792673216 >> v2:172.21.15.151:3300/0 conn(0x7f53c00b6030 0x7f53c006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 -- 172.21.15.94:0/1792673216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 msgr2=0x7f53c00b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 --2- 172.21.15.94:0/1792673216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c00b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 -- 172.21.15.94:0/1792673216 >> v2:172.21.15.151:3300/0 conn(0x7f53c00b6030 msgr2=0x7f53c006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 --2- 172.21.15.94:0/1792673216 >> v2:172.21.15.151:3300/0 conn(0x7f53c00b6030 0x7f53c006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 -- 172.21.15.94:0/1792673216 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0071340 con 0x7f53c0140600 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bed9d700 1 --2- 172.21.15.94:0/1792673216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c0140600 0x7f53c0140a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53c00b9ee0 tx=0x7f53b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde63a647471c2a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bd59a700 1 -- 172.21.15.94:0/1792673216 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800e070 con 0x7f53c0140600 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bd59a700 1 -- 172.21.15.94:0/1792673216 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b800b910 con 0x7f53c0140600 2024-03-18T18:09:12.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53bd59a700 1 -- 172.21.15.94:0/1792673216 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800bcc0 con 0x7f53c0140600 2024-03-18T18:09:12.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- 172.21.15.94:0/1792673216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c0140600 msgr2=0x7f53c0140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- 172.21.15.94:0/1792673216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c0140600 0x7f53c0140a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f53c00b9ee0 tx=0x7f53b800b330 comp rx=0 tx=0).stop 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- 172.21.15.94:0/1792673216 shutdown_connections 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- 172.21.15.94:0/1792673216 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c0140600 0x7f53c0140a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- 172.21.15.94:0/1792673216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c00b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 --2- 172.21.15.94:0/1792673216 >> v2:172.21.15.151:3300/0 conn(0x7f53c00b6030 0x7f53c006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- 172.21.15.94:0/1792673216 >> 172.21.15.94:0/1792673216 conn(0x7f53c006bc70 msgr2=0x7f53c006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- 172.21.15.94:0/1792673216 shutdown_connections 2024-03-18T18:09:12.579 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.572+0000 7f53c49df700 1 -- 172.21.15.94:0/1792673216 wait complete. 2024-03-18T18:09:12.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 Processor -- start 2024-03-18T18:09:12.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 -- start start 2024-03-18T18:09:12.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c0142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.581 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 0x7f53c01df260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53c0140600 0x7f53c01df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01dbcf0 con 0x7f53c00b6030 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0144bd0 con 0x7f53c0140600 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53c49df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01dbf40 con 0x7f53c00720e0 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 0x7f53c01df260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 0x7f53c01df260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45248/0 (socket says 172.21.15.94:45248) 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 -- 172.21.15.94:0/3076172541 learned_addr learned my addr 172.21.15.94:0/3076172541 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bed9d700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53c0140600 0x7f53c01df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53be59c700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c0142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 -- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 msgr2=0x7f53c0142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c0142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 -- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53c0140600 msgr2=0x7f53c01df7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53c0140600 0x7f53c01df7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 -- 172.21.15.94:0/3076172541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8009b30 con 0x7f53c00b6030 2024-03-18T18:09:12.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53bdd9b700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 0x7f53c01df260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53b000e940 tx=0x7f53b000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:12.583 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.576+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0013680 con 0x7f53c00b6030 2024-03-18T18:09:12.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.580+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b00137e0 con 0x7f53c00b6030 2024-03-18T18:09:12.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.580+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c01dc220 con 0x7f53c00b6030 2024-03-18T18:09:12.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.580+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0013b70 con 0x7f53c00b6030 2024-03-18T18:09:12.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.580+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c00af280 con 0x7f53c00b6030 2024-03-18T18:09:12.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.580+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c0067620 con 0x7f53c00b6030 2024-03-18T18:09:12.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.580+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f53b0013cd0 con 0x7f53c00b6030 2024-03-18T18:09:12.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.584+0000 7f53b6ffd700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f53a0066730 0x7f53a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.584+0000 7f53be59c700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f53a0066730 0x7f53a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.584+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f53b0083fd0 con 0x7f53c00b6030 2024-03-18T18:09:12.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.584+0000 7f53be59c700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f53a0066730 0x7f53a0068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009bf0 tx=0x7f53a8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:12.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.592+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f53b0051430 con 0x7f53c00b6030 2024-03-18T18:09:12.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.796+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f53c01dc410 con 0x7f53c00b6030 2024-03-18T18:09:12.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.812+0000 7f53b6ffd700 1 -- 172.21.15.94:0/3076172541 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53b0054a50 con 0x7f53c00b6030 2024-03-18T18:09:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f53a0066730 msgr2=0x7f53a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f53a0066730 0x7f53a0068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009bf0 tx=0x7f53a8009240 comp rx=0 tx=0).stop 2024-03-18T18:09:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 msgr2=0x7f53c01df260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 0x7f53c01df260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53b000e940 tx=0x7f53b000ec50 comp rx=0 tx=0).stop 2024-03-18T18:09:12.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 shutdown_connections 2024-03-18T18:09:12.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f53a0066730 0x7f53a0068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53c0140600 0x7f53c01df7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53c00b6030 0x7f53c01df260 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53b000e940 tx=0x7f53b000ec50 comp rx=0 tx=0).stop 2024-03-18T18:09:12.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 --2- 172.21.15.94:0/3076172541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53c00720e0 0x7f53c0142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.816+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 >> 172.21.15.94:0/3076172541 conn(0x7f53c006bc70 msgr2=0x7f53c013bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:12.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.828+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 shutdown_connections 2024-03-18T18:09:12.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.828+0000 7f53c49df700 1 -- 172.21.15.94:0/3076172541 wait complete. 2024-03-18T18:09:12.835 INFO:teuthology.orchestra.run.smithi094.stderr:new fs with metadata pool 2 and data pool 3 2024-03-18T18:09:12.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:12.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5645a4e700 1 Processor -- start 2024-03-18T18:09:12.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5645a4e700 1 -- start start 2024-03-18T18:09:12.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5645a4e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f564014e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5645a4e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400b0210 con 0x7f56400b0910 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5645a4e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5640072b50 con 0x7f56400b1430 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5645a4e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400afa10 con 0x7f56400b4300 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563ffff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f56400b0910 0x7f5640145ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46660/0 (socket says 172.21.15.94:46660) 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563ffff700 1 -- 172.21.15.94:0/907732078 learned_addr learned my addr 172.21.15.94:0/907732078 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531909585 0 0) 0x7f56400b0210 con 0x7f56400b0910 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f564524d700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f564014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56280035d0 con 0x7f56400b0910 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238192540 0 0) 0x7f56280035d0 con 0x7f56400b0910 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 msgr2=0x7f564014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f564014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 >> v1:172.21.15.151:6789/0 conn(0x7f56400b1430 legacy=0x7f5640072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400afcf0 con 0x7f56400b0910 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f56380019f0 con 0x7f56400b0910 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f564524d700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f564014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:12.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 >> v1:172.21.15.94:6789/0 conn(0x7f56400b0910 legacy=0x7f5640145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f5628003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5628004040 0x7f5628004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5628004db0 0x7f5628005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400afa10 con 0x7f5628004db0 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562800bbf0 con 0x7f5628004040 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562800bdb0 con 0x7f56400b4300 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f5628003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563ffff700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5628004040 0x7f5628004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f564524d700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5628004db0 0x7f5628005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 -- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5628004040 msgr2=0x7f5628004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5628004040 0x7f5628004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 -- 172.21.15.94:0/907732078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5628004db0 msgr2=0x7f5628005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:12.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5628004db0 0x7f5628005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 -- 172.21.15.94:0/907732078 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280035d0 con 0x7f56400b4300 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f5644a4c700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f5628003a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56300017e0 tx=0x7f56280058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caad3b283b5bf1f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.944+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300052d0 con 0x7f56400b4300 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630005430 con 0x7f56400b4300 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f563f7fe700 1 -- 172.21.15.94:0/907732078 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300055a0 con 0x7f56400b4300 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 msgr2=0x7f5628003a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 --2- 172.21.15.94:0/907732078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56400b4300 0x7f5628003a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56300017e0 tx=0x7f56280058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f564524d700 1 -- 172.21.15.94:0/907732078 reap_dead start 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- 172.21.15.94:0/907732078 shutdown_connections 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- 172.21.15.94:0/907732078 >> 172.21.15.94:0/907732078 conn(0x7f56400b8ee0 msgr2=0x7f56400b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- 172.21.15.94:0/907732078 shutdown_connections 2024-03-18T18:09:12.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- 172.21.15.94:0/907732078 wait complete. 2024-03-18T18:09:12.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 Processor -- start 2024-03-18T18:09:12.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- start start 2024-03-18T18:09:12.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 0x7f564013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56401d7850 0x7f56400a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f564013a440 0x7f564013a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640142f50 con 0x7f56400b4300 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640143190 con 0x7f564013a440 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.948+0000 7f5645a4e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56401d73c0 con 0x7f56401d7850 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 0x7f564013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f563ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56401d7850 0x7f56400a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 0x7f564013fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45254/0 (socket says 172.21.15.94:45254) 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f563ffff700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56401d7850 0x7f56400a8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:45850/0 (socket says 172.21.15.94:45850) 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 -- 172.21.15.94:0/1996896094 learned_addr learned my addr 172.21.15.94:0/1996896094 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f564524d700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f564013a440 0x7f564013a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 -- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56401d7850 msgr2=0x7f56400a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56401d7850 0x7f56400a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 -- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f564013a440 msgr2=0x7f564013a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f564013a440 0x7f564013a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:12.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 -- 172.21.15.94:0/1996896094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400a8ce0 con 0x7f56400b4300 2024-03-18T18:09:12.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5644a4c700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 0x7f564013fb50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5630006ae0 tx=0x7f5630001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:12.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300055a0 con 0x7f56400b4300 2024-03-18T18:09:12.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630007240 con 0x7f56400b4300 2024-03-18T18:09:12.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56401d7050 con 0x7f56400b4300 2024-03-18T18:09:12.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300075d0 con 0x7f56400b4300 2024-03-18T18:09:12.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564013ae00 con 0x7f56400b4300 2024-03-18T18:09:12.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.952+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5640067620 con 0x7f56400b4300 2024-03-18T18:09:12.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.956+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f56300036a0 con 0x7f56400b4300 2024-03-18T18:09:12.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.956+0000 7f563d7fa700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f562c066730 0x7f562c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:12.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.956+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5630085130 con 0x7f56400b4300 2024-03-18T18:09:12.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.956+0000 7f563ffff700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f562c066730 0x7f562c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:12.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.956+0000 7f563ffff700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f562c066730 0x7f562c068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5638001e20 tx=0x7f5638006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:12.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:12.960+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f56300525b0 con 0x7f56400b4300 2024-03-18T18:09:13.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.128+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56401d6eb0 con 0x7f56400b4300 2024-03-18T18:09:13.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.128+0000 7f563d7fa700 1 -- 172.21.15.94:0/1996896094 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f56401d6eb0 con 0x7f56400b4300 2024-03-18T18:09:13.134 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:13.134 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:12.801486+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f562c066730 msgr2=0x7f562c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f562c066730 0x7f562c068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5638001e20 tx=0x7f5638006040 comp rx=0 tx=0).stop 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 msgr2=0x7f564013fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 0x7f564013fb50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5630006ae0 tx=0x7f5630001120 comp rx=0 tx=0).stop 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 shutdown_connections 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f562c066730 0x7f562c068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f564013a440 0x7f564013a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56401d7850 0x7f56400a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 --2- 172.21.15.94:0/1996896094 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56400b4300 0x7f564013fb50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 >> 172.21.15.94:0/1996896094 conn(0x7f56400b8ee0 msgr2=0x7f56400b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:13.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 shutdown_connections 2024-03-18T18:09:13.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.132+0000 7f5645a4e700 1 -- 172.21.15.94:0/1996896094 wait complete. 2024-03-18T18:09:13.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:13.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.252+0000 7f6a964a2700 1 Processor -- start 2024-03-18T18:09:13.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.252+0000 7f6a964a2700 1 -- start start 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a9006a3c0 0x7f6a90071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a900b51f0 0x7f6a901404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a90140a10 0x7f6a9006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900b4a30 con 0x7f6a900b51f0 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9006a7a0 con 0x7f6a9006a3c0 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900b4cd0 con 0x7f6a90140a10 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a900b51f0 0x7f6a901404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6a900b51f0 0x7f6a901404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45258/0 (socket says 172.21.15.94:45258) 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 -- 172.21.15.94:0/2475936478 learned_addr learned my addr 172.21.15.94:0/2475936478 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:13.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a95ca1700 1 --2- 172.21.15.94:0/2475936478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a90140a10 0x7f6a9006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a954a0700 1 --2- 172.21.15.94:0/2475936478 >> v2:172.21.15.151:3300/0 conn(0x7f6a9006a3c0 0x7f6a90071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 -- 172.21.15.94:0/2475936478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a90140a10 msgr2=0x7f6a9006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 --2- 172.21.15.94:0/2475936478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a90140a10 0x7f6a9006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 -- 172.21.15.94:0/2475936478 >> v2:172.21.15.151:3300/0 conn(0x7f6a9006a3c0 msgr2=0x7f6a90071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 --2- 172.21.15.94:0/2475936478 >> v2:172.21.15.151:3300/0 conn(0x7f6a9006a3c0 0x7f6a90071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 -- 172.21.15.94:0/2475936478 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a90071650 con 0x7f6a900b51f0 2024-03-18T18:09:13.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a94c9f700 1 --2- 172.21.15.94:0/2475936478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a900b51f0 0x7f6a901404d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006b230 tx=0x7f6a80009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaca49f7e2570ca9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a87fff700 1 -- 172.21.15.94:0/2475936478 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000b8a0 con 0x7f6a900b51f0 2024-03-18T18:09:13.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a87fff700 1 -- 172.21.15.94:0/2475936478 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000ba00 con 0x7f6a900b51f0 2024-03-18T18:09:13.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a87fff700 1 -- 172.21.15.94:0/2475936478 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000bd90 con 0x7f6a900b51f0 2024-03-18T18:09:13.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- 172.21.15.94:0/2475936478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a900b51f0 msgr2=0x7f6a901404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- 172.21.15.94:0/2475936478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a900b51f0 0x7f6a901404d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006b230 tx=0x7f6a80009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- 172.21.15.94:0/2475936478 shutdown_connections 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- 172.21.15.94:0/2475936478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a90140a10 0x7f6a9006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- 172.21.15.94:0/2475936478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a900b51f0 0x7f6a901404d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 --2- 172.21.15.94:0/2475936478 >> v2:172.21.15.151:3300/0 conn(0x7f6a9006a3c0 0x7f6a90071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- 172.21.15.94:0/2475936478 >> 172.21.15.94:0/2475936478 conn(0x7f6a900b8d80 msgr2=0x7f6a900b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- 172.21.15.94:0/2475936478 shutdown_connections 2024-03-18T18:09:13.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.256+0000 7f6a964a2700 1 -- 172.21.15.94:0/2475936478 wait complete. 2024-03-18T18:09:13.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 Processor -- start 2024-03-18T18:09:13.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 -- start start 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9006a3c0 0x7f6a900b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a900b51f0 0x7f6a901df150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 0x7f6a901df690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90141a50 con 0x7f6a90140a10 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900af950 con 0x7f6a900b51f0 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a964a2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90141f80 con 0x7f6a9006a3c0 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.260+0000 7f6a95ca1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 0x7f6a901df690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 0x7f6a901df690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45268/0 (socket says 172.21.15.94:45268) 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 -- 172.21.15.94:0/1465475392 learned_addr learned my addr 172.21.15.94:0/1465475392 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a94c9f700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a900b51f0 0x7f6a901df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a954a0700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9006a3c0 0x7f6a900b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 -- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9006a3c0 msgr2=0x7f6a900b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9006a3c0 0x7f6a900b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 -- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a900b51f0 msgr2=0x7f6a901df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a900b51f0 0x7f6a901df150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 -- 172.21.15.94:0/1465475392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009570 con 0x7f6a90140a10 2024-03-18T18:09:13.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a95ca1700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 0x7f6a901df690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a88007e60 tx=0x7f6a8800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800ed30 con 0x7f6a90140a10 2024-03-18T18:09:13.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800ee90 con 0x7f6a90140a10 2024-03-18T18:09:13.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a900af390 con 0x7f6a90140a10 2024-03-18T18:09:13.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88014660 con 0x7f6a90140a10 2024-03-18T18:09:13.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a90141ca0 con 0x7f6a90140a10 2024-03-18T18:09:13.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a90070490 con 0x7f6a90140a10 2024-03-18T18:09:13.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.264+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6a880147c0 con 0x7f6a90140a10 2024-03-18T18:09:13.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.268+0000 7f6a85ffb700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6a74066730 0x7f6a74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.268+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a88084780 con 0x7f6a90140a10 2024-03-18T18:09:13.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.268+0000 7f6a954a0700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6a74066730 0x7f6a74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.268+0000 7f6a954a0700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6a74066730 0x7f6a74068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0045f0 tx=0x7f6a8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.276+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6a88051b80 con 0x7f6a90140a10 2024-03-18T18:09:13.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.444+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a90074440 con 0x7f6a90140a10 2024-03-18T18:09:13.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a85ffb700 1 -- 172.21.15.94:0/1465475392 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f6a880551a0 con 0x7f6a90140a10 2024-03-18T18:09:13.451 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:13.451 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:12.801486+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6a74066730 msgr2=0x7f6a74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6a74066730 0x7f6a74068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0045f0 tx=0x7f6a8c008040 comp rx=0 tx=0).stop 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 msgr2=0x7f6a901df690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 0x7f6a901df690 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6a88007e60 tx=0x7f6a8800e3c0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 shutdown_connections 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6a74066730 0x7f6a74068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6a90140a10 0x7f6a901df690 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a900b51f0 0x7f6a901df150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 --2- 172.21.15.94:0/1465475392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9006a3c0 0x7f6a900b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 >> 172.21.15.94:0/1465475392 conn(0x7f6a900b8d80 msgr2=0x7f6a9013f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 shutdown_connections 2024-03-18T18:09:13.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.448+0000 7f6a964a2700 1 -- 172.21.15.94:0/1465475392 wait complete. 2024-03-18T18:09:13.466 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-18T18:09:13.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917759e700 1 Processor -- start 2024-03-18T18:09:13.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917759e700 1 -- start start 2024-03-18T18:09:13.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9178150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917759e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917806ed90 con 0x7f9178071960 2024-03-18T18:09:13.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917759e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917806efd0 con 0x7f91780b8480 2024-03-18T18:09:13.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780b1eb0 con 0x7f9178071e10 2024-03-18T18:09:13.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f9175d9b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9178071960 0x7f917814cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46668/0 (socket says 172.21.15.94:46668) 2024-03-18T18:09:13.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f9175d9b700 1 -- 172.21.15.94:0/86725000 learned_addr learned my addr 172.21.15.94:0/86725000 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:13.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f9176d9d700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9178150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271902394 0 0) 0x7f9168001110 con 0x7f9178071960 2024-03-18T18:09:13.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91640035d0 con 0x7f9178071960 2024-03-18T18:09:13.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2689355155 0 0) 0x7f91640035d0 con 0x7f9178071960 2024-03-18T18:09:13.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 msgr2=0x7f9178150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:13.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9178150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 >> v1:172.21.15.151:6789/0 conn(0x7f91780b8480 legacy=0x7f9178144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780b8860 con 0x7f9178071960 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f9168001800 con 0x7f9178071960 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 >> v1:172.21.15.94:6789/0 conn(0x7f9178071960 legacy=0x7f917814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9164003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9164003fd0 0x7f9164004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f9164005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780b1eb0 con 0x7f9164004db0 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400bbc0 con 0x7f9164003fd0 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916400bd80 con 0x7f9178071e10 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.580+0000 7f9176d9d700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f9164005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917659c700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9164003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9175d9b700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9164003fd0 0x7f9164004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 -- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 msgr2=0x7f9164003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9164003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 -- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9164003fd0 msgr2=0x7f9164004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9164003fd0 0x7f9164004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 -- 172.21.15.94:0/86725000 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640035d0 con 0x7f9164004db0 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917659c700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9178071e10 0x7f9164003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f9164005230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9170009fc0 tx=0x7f91640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fee864d49acdd4f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000ec30 con 0x7f9164004db0 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917000f040 con 0x7f9164004db0 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917559a700 1 -- 172.21.15.94:0/86725000 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170014480 con 0x7f9164004db0 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 -- 172.21.15.94:0/86725000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 msgr2=0x7f9164005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 --2- 172.21.15.94:0/86725000 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f9164005230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9170009fc0 tx=0x7f91640058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f9176d9d700 1 -- 172.21.15.94:0/86725000 reap_dead start 2024-03-18T18:09:13.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 -- 172.21.15.94:0/86725000 shutdown_connections 2024-03-18T18:09:13.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 -- 172.21.15.94:0/86725000 >> 172.21.15.94:0/86725000 conn(0x7f917806a780 msgr2=0x7f91780b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:13.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 -- 172.21.15.94:0/86725000 shutdown_connections 2024-03-18T18:09:13.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 -- 172.21.15.94:0/86725000 wait complete. 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 Processor -- start 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.584+0000 7f917759e700 1 -- start start 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f91781d8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91780ac580 0x7f91780adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91780aa970 0x7f91780aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781d7600 con 0x7f9164004db0 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780a9e80 con 0x7f91780ac580 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91781d7810 con 0x7f91780aa970 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f91781d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f91781d8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45286/0 (socket says 172.21.15.94:45286) 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 -- 172.21.15.94:0/2123624568 learned_addr learned my addr 172.21.15.94:0/2123624568 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:13.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f9175d9b700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91780ac580 0x7f91780adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f9176d9d700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91780aa970 0x7f91780aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 -- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91780aa970 msgr2=0x7f91780aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91780aa970 0x7f91780aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 -- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91780ac580 msgr2=0x7f91780adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91780ac580 0x7f91780adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 -- 172.21.15.94:0/2123624568 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91781d7af0 con 0x7f9164004db0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917659c700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f91781d8010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f916000e7e0 tx=0x7f916000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600052e0 con 0x7f9164004db0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160005440 con 0x7f9164004db0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91780ad7d0 con 0x7f9164004db0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600038c0 con 0x7f9164004db0 2024-03-18T18:09:13.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91780ae4a0 con 0x7f9164004db0 2024-03-18T18:09:13.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.588+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9178074440 con 0x7f9164004db0 2024-03-18T18:09:13.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.592+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9160003a20 con 0x7f9164004db0 2024-03-18T18:09:13.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.592+0000 7f916effd700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9158066780 0x7f9158068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.592+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91600837b0 con 0x7f9164004db0 2024-03-18T18:09:13.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.592+0000 7f9175d9b700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9158066780 0x7f9158068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.592+0000 7f9175d9b700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9158066780 0x7f9158068c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9178142a60 tx=0x7f9168007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.600+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9160050c60 con 0x7f9164004db0 2024-03-18T18:09:13.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.800+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91781d7c80 con 0x7f9164004db0 2024-03-18T18:09:13.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.808+0000 7f916effd700 1 -- 172.21.15.94:0/2123624568 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91600190b0 con 0x7f9164004db0 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9158066780 msgr2=0x7f9158068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9158066780 0x7f9158068c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9178142a60 tx=0x7f9168007040 comp rx=0 tx=0).stop 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 msgr2=0x7f91781d8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f91781d8010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f916000e7e0 tx=0x7f916000eaf0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 shutdown_connections 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9158066780 0x7f9158068c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91780aa970 0x7f91780aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91780ac580 0x7f91780adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 --2- 172.21.15.94:0/2123624568 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9164004db0 0x7f91781d8010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 >> 172.21.15.94:0/2123624568 conn(0x7f917806a780 msgr2=0x7f9178142330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 shutdown_connections 2024-03-18T18:09:13.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.812+0000 7f917759e700 1 -- 172.21.15.94:0/2123624568 wait complete. 2024-03-18T18:09:13.828 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-18T18:09:13.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T18:09:13.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 Processor -- start 2024-03-18T18:09:13.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 -- start start 2024-03-18T18:09:13.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce540bc730 0x7fce540b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce54140090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce540b34c0 con 0x7fce540b8400 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce540b5f00 con 0x7fce540bc730 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a9aa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540bcb10 con 0x7fce54146ba0 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce599a8700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce540bc730 0x7fce540b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce591a7700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fce540b8400 0x7fce54146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:46674/0 (socket says 172.21.15.94:46674) 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce591a7700 1 -- 172.21.15.94:0/4172588961 learned_addr learned my addr 172.21.15.94:0/4172588961 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce5a1a9700 1 --2- 172.21.15.94:0/4172588961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce54140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.936+0000 7fce589a6700 1 -- 172.21.15.94:0/4172588961 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241052259 0 0) 0x7fce540b34c0 con 0x7fce540b8400 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce589a6700 1 -- 172.21.15.94:0/4172588961 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce400035d0 con 0x7fce540b8400 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce599a8700 1 -- 172.21.15.94:0/4172588961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 msgr2=0x7fce54140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:13.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce599a8700 1 --2- 172.21.15.94:0/4172588961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce54140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce599a8700 1 -- 172.21.15.94:0/4172588961 >> v1:172.21.15.94:6789/0 conn(0x7fce540b8400 legacy=0x7fce54146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce599a8700 1 -- 172.21.15.94:0/4172588961 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540b3710 con 0x7fce540bc730 2024-03-18T18:09:13.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce599a8700 1 --2- 172.21.15.94:0/4172588961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce540b4ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce48009850 tx=0x7fce48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec925b574738771 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce589a6700 1 -- 172.21.15.94:0/4172588961 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48011830 con 0x7fce540bc730 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce589a6700 1 -- 172.21.15.94:0/4172588961 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48011990 con 0x7fce540bc730 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce589a6700 1 -- 172.21.15.94:0/4172588961 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48011d40 con 0x7fce540bc730 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 -- 172.21.15.94:0/4172588961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 msgr2=0x7fce540b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/4172588961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce540b4ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce48009850 tx=0x7fce48009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 -- 172.21.15.94:0/4172588961 shutdown_connections 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/4172588961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce54140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/4172588961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce540b4ad0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 -- 172.21.15.94:0/4172588961 >> 172.21.15.94:0/4172588961 conn(0x7fce54073600 msgr2=0x7fce540bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:13.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 -- 172.21.15.94:0/4172588961 shutdown_connections 2024-03-18T18:09:13.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 -- 172.21.15.94:0/4172588961 wait complete. 2024-03-18T18:09:13.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 Processor -- start 2024-03-18T18:09:13.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.940+0000 7fce5a9aa700 1 -- start start 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce540b8400 0x7fce541db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce54140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce540b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce541440c0 con 0x7fce540bc730 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54142a00 con 0x7fce540b8400 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce54141aa0 con 0x7fce54146ba0 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce54140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce54140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:45302/0 (socket says 172.21.15.94:45302) 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 -- 172.21.15.94:0/1025239943 learned_addr learned my addr 172.21.15.94:0/1025239943 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:13.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce599a8700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce540b8400 0x7fce541db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a1a9700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce540b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 -- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 msgr2=0x7fce540b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce540b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 -- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce540b8400 msgr2=0x7fce541db4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce540b8400 0x7fce541db4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 -- 172.21.15.94:0/1025239943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480094b0 con 0x7fce540bc730 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce591a7700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce54140d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c700 tx=0x7fce5000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50005d90 con 0x7fce540bc730 2024-03-18T18:09:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce54143e20 con 0x7fce540bc730 2024-03-18T18:09:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce500070d0 con 0x7fce540bc730 2024-03-18T18:09:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50007480 con 0x7fce540bc730 2024-03-18T18:09:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.944+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce54143a40 con 0x7fce540bc730 2024-03-18T18:09:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.948+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce54144cd0 con 0x7fce540bc730 2024-03-18T18:09:13.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.948+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fce500075e0 con 0x7fce540bc730 2024-03-18T18:09:13.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.948+0000 7fce467fc700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fce38066730 0x7fce38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:13.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.948+0000 7fce599a8700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fce38066730 0x7fce38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:13.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.948+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce50083650 con 0x7fce540bc730 2024-03-18T18:09:13.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.948+0000 7fce599a8700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fce38066730 0x7fce38068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce480090b0 tx=0x7fce48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:13.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:13.956+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fce50050930 con 0x7fce540bc730 2024-03-18T18:09:14.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.164+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fce54074440 con 0x7fce540bc730 2024-03-18T18:09:14.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.820+0000 7fce467fc700 1 -- 172.21.15.94:0/1025239943 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fce50053f50 con 0x7fce540bc730 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fce38066730 msgr2=0x7fce38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fce38066730 0x7fce38068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce480090b0 tx=0x7fce48008030 comp rx=0 tx=0).stop 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 msgr2=0x7fce54140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce54140d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c700 tx=0x7fce5000ca10 comp rx=0 tx=0).stop 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 shutdown_connections 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fce38066730 0x7fce38068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce54146ba0 0x7fce540b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce540bc730 0x7fce54140d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 --2- 172.21.15.94:0/1025239943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce540b8400 0x7fce541db4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 >> 172.21.15.94:0/1025239943 conn(0x7fce54073600 msgr2=0x7fce54145680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 shutdown_connections 2024-03-18T18:09:14.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.824+0000 7fce5a9aa700 1 -- 172.21.15.94:0/1025239943 wait complete. 2024-03-18T18:09:14.846 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-18T18:09:14.846 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:09:14.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 Processor -- start 2024-03-18T18:09:14.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 -- start start 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6eac0ae6b0 0x7f6eac0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0b0410 0x7f6eac0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0b1780 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0b2b30 con 0x7f6eac0ae6b0 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb123a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac06eec0 con 0x7f6eac0b0410 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6eac0ae6b0 0x7f6eac0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6eac0ae6b0 0x7f6eac0b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35076/0 (socket says 172.21.15.94:35076) 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 -- 172.21.15.94:0/895003621 learned_addr learned my addr 172.21.15.94:0/895003621 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:14.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eb0a39700 1 --2- 172.21.15.94:0/895003621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0b0410 0x7f6eac0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 -- 172.21.15.94:0/895003621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0b0410 msgr2=0x7f6eac0b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 --2- 172.21.15.94:0/895003621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0b0410 0x7f6eac0b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 -- 172.21.15.94:0/895003621 >> v1:172.21.15.151:6789/0 conn(0x7f6eac0b3ff0 legacy=0x7f6eac0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 -- 172.21.15.94:0/895003621 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0b1130 con 0x7f6eac0ae6b0 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eab7fe700 1 --2- 172.21.15.94:0/895003621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0ae6b0 0x7f6eac0b2f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00d150 tx=0x7f6e9c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3629dd47148742f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eaaffd700 1 -- 172.21.15.94:0/895003621 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c010070 con 0x7f6eac0ae6b0 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eaaffd700 1 -- 172.21.15.94:0/895003621 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00ddc0 con 0x7f6eac0ae6b0 2024-03-18T18:09:14.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.956+0000 7f6eaaffd700 1 -- 172.21.15.94:0/895003621 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00b310 con 0x7f6eac0ae6b0 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 -- 172.21.15.94:0/895003621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0ae6b0 msgr2=0x7f6eac0b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 --2- 172.21.15.94:0/895003621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0ae6b0 0x7f6eac0b2f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00d150 tx=0x7f6e9c00d460 comp rx=0 tx=0).stop 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 -- 172.21.15.94:0/895003621 shutdown_connections 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 --2- 172.21.15.94:0/895003621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0b0410 0x7f6eac0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 --2- 172.21.15.94:0/895003621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0ae6b0 0x7f6eac0b2f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 -- 172.21.15.94:0/895003621 >> 172.21.15.94:0/895003621 conn(0x7f6eac0b7a20 msgr2=0x7f6eac0b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 -- 172.21.15.94:0/895003621 shutdown_connections 2024-03-18T18:09:14.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 -- 172.21.15.94:0/895003621 wait complete. 2024-03-18T18:09:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 Processor -- start 2024-03-18T18:09:14.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.960+0000 7f6eb123a700 1 -- start start 2024-03-18T18:09:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0ae6b0 0x7f6eac1db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:14.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 0x7f6eac1d7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 0x7f6eac13f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1daed0 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1d7740 con 0x7f6eac0b0410 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0ae2e0 con 0x7f6eac0ae6b0 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 0x7f6eac13f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 0x7f6eac1d7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eabfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0ae6b0 0x7f6eac1db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eabfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0ae6b0 0x7f6eac1db2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52320/0 (socket says 172.21.15.94:52320) 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 0x7f6eac13f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35082/0 (socket says 172.21.15.94:35082) 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 0x7f6eac1d7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57576/0 (socket says 172.21.15.94:57576) 2024-03-18T18:09:14.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eabfff700 1 -- 172.21.15.94:0/3459550002 learned_addr learned my addr 172.21.15.94:0/3459550002 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:14.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 -- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0ae6b0 msgr2=0x7f6eac1db2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0ae6b0 0x7f6eac1db2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 -- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 msgr2=0x7f6eac1d7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 0x7f6eac1d7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 -- 172.21.15.94:0/3459550002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c00bd40 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eab7fe700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 0x7f6eac1d7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb0a39700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 0x7f6eac13f820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400e7e0 tx=0x7f6ea400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400c070 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0aae40 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4013610 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40139c0 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.964+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac1daaf0 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.968+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac1db010 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.968+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6ea4013b20 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.968+0000 7f6ea8ff9700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6e98066730 0x7f6e98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.968+0000 7f6eabfff700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6e98066730 0x7f6e98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.968+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ea4083de0 con 0x7f6eac0b3ff0 2024-03-18T18:09:14.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.968+0000 7f6eabfff700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6e98066730 0x7f6e98068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0001850 tx=0x7f6ea0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:14.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:14.976+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6eac1db010 con 0x7f6eac0b3ff0 2024-03-18T18:09:15.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.180+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eac1db010 con 0x7f6eac0b3ff0 2024-03-18T18:09:15.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.180+0000 7f6ea8ff9700 1 -- 172.21.15.94:0/3459550002 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3210 (secure 0 0 0) 0x7f6ea4017ca0 con 0x7f6eac0b3ff0 2024-03-18T18:09:15.185 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:15.185 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T18:09:12.802236+0000","modified":"2024-03-18T18:09:14.818548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-18T18:09:15.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6e98066730 msgr2=0x7f6e98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6e98066730 0x7f6e98068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0001850 tx=0x7f6ea0009040 comp rx=0 tx=0).stop 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 msgr2=0x7f6eac13f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 0x7f6eac13f820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400e7e0 tx=0x7f6ea400eaf0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 shutdown_connections 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6e98066730 0x7f6e98068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6eac0b3ff0 0x7f6eac13f820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac0b0410 0x7f6eac1d7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 --2- 172.21.15.94:0/3459550002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eac0ae6b0 0x7f6eac1db2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 >> 172.21.15.94:0/3459550002 conn(0x7f6eac0b7a20 msgr2=0x7f6eac0b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 shutdown_connections 2024-03-18T18:09:15.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.184+0000 7f6eb123a700 1 -- 172.21.15.94:0/3459550002 wait complete. 2024-03-18T18:09:15.189 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-03-18T18:09:15.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.304+0000 7fe34583b700 1 Processor -- start 2024-03-18T18:09:15.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.304+0000 7fe34583b700 1 -- start start 2024-03-18T18:09:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe340142450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe340072440 0x7fe3400728a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3401432a0 con 0x7fe34006cbc0 2024-03-18T18:09:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34013c980 con 0x7fe340072440 2024-03-18T18:09:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34006ea20 con 0x7fe3400b1090 2024-03-18T18:09:15.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe340072440 0x7fe3400728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe344839700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe340142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe340072440 0x7fe3400728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57588/0 (socket says 172.21.15.94:57588) 2024-03-18T18:09:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 -- 172.21.15.94:0/1220986240 learned_addr learned my addr 172.21.15.94:0/1220986240 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe344839700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe340142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52326/0 (socket says 172.21.15.94:52326) 2024-03-18T18:09:15.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 -- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 msgr2=0x7fe340142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 --2- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe340142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 -- 172.21.15.94:0/1220986240 >> v1:172.21.15.151:6789/0 conn(0x7fe34006cbc0 legacy=0x7fe3400af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 -- 172.21.15.94:0/1220986240 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3400b1470 con 0x7fe340072440 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe344839700 1 --2- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe340142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33ffff700 1 --2- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3400728a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe33000d150 tx=0x7fe33000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11b2ec77ad09d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33f7fe700 1 -- 172.21.15.94:0/1220986240 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330010070 con 0x7fe340072440 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33f7fe700 1 -- 172.21.15.94:0/1220986240 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33000dd10 con 0x7fe340072440 2024-03-18T18:09:15.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe33f7fe700 1 -- 172.21.15.94:0/1220986240 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33000b310 con 0x7fe340072440 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 msgr2=0x7fe3400728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 --2- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3400728a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe33000d150 tx=0x7fe33000d460 comp rx=0 tx=0).stop 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- 172.21.15.94:0/1220986240 shutdown_connections 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 --2- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3400728a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 --2- 172.21.15.94:0/1220986240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe340142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- 172.21.15.94:0/1220986240 >> 172.21.15.94:0/1220986240 conn(0x7fe3400b7a20 msgr2=0x7fe3400b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- 172.21.15.94:0/1220986240 shutdown_connections 2024-03-18T18:09:15.314 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.308+0000 7fe34583b700 1 -- 172.21.15.94:0/1220986240 wait complete. 2024-03-18T18:09:15.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 Processor -- start 2024-03-18T18:09:15.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 -- start start 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 0x7fe340141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3401ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe3401dea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3401415a0 con 0x7fe34006cbc0 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe340140de0 con 0x7fe340072440 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34006f960 con 0x7fe3400b1090 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 0x7fe340141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 0x7fe340141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35098/0 (socket says 172.21.15.94:35098) 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 -- 172.21.15.94:0/2156258697 learned_addr learned my addr 172.21.15.94:0/2156258697 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe33ffff700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3401ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34503a700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe3401dea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 -- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 msgr2=0x7fe3401dea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe3401dea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 -- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 msgr2=0x7fe3401ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3401ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 -- 172.21.15.94:0/2156258697 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340094b0 con 0x7fe34006cbc0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe344839700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 0x7fe340141d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe33400ebe0 tx=0x7fe33400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334009770 con 0x7fe34006cbc0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400c850 con 0x7fe34006cbc0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33000bd40 con 0x7fe34006cbc0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400cbe0 con 0x7fe34006cbc0 2024-03-18T18:09:15.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.312+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe340142240 con 0x7fe34006cbc0 2024-03-18T18:09:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.316+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340074440 con 0x7fe34006cbc0 2024-03-18T18:09:15.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.316+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe33400cd40 con 0x7fe34006cbc0 2024-03-18T18:09:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.316+0000 7fe33d7fa700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe32c066730 0x7fe32c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.316+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3340840f0 con 0x7fe34006cbc0 2024-03-18T18:09:15.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.316+0000 7fe33ffff700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe32c066730 0x7fe32c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.316+0000 7fe33ffff700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe32c066730 0x7fe32c068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe330000f80 tx=0x7fe33000b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.320+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe334051470 con 0x7fe34006cbc0 2024-03-18T18:09:15.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.492+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3400acaf0 con 0x7fe34006cbc0 2024-03-18T18:09:15.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.496+0000 7fe33d7fa700 1 -- 172.21.15.94:0/2156258697 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fe334054a90 con 0x7fe34006cbc0 2024-03-18T18:09:15.500 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:15.500 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":22,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:13.808682+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:15.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.496+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe32c066730 msgr2=0x7fe32c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.496+0000 7fe34583b700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe32c066730 0x7fe32c068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe330000f80 tx=0x7fe33000b000 comp rx=0 tx=0).stop 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.496+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 msgr2=0x7fe340141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.496+0000 7fe34583b700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 0x7fe340141d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe33400ebe0 tx=0x7fe33400eef0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 shutdown_connections 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe32c066730 0x7fe32c068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3400b1090 0x7fe3401dea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe340072440 0x7fe3401ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 --2- 172.21.15.94:0/2156258697 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe34006cbc0 0x7fe340141d00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 >> 172.21.15.94:0/2156258697 conn(0x7fe3400b7a20 msgr2=0x7fe3400b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 shutdown_connections 2024-03-18T18:09:15.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.500+0000 7fe34583b700 1 -- 172.21.15.94:0/2156258697 wait complete. 2024-03-18T18:09:15.515 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-18T18:09:15.515 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:15.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 Processor -- start 2024-03-18T18:09:15.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- start start 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb44037a00 0x7fdb440cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb440bf9a0 0x7fdb440bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb44039550 con 0x7fdb44037de0 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440cd900 con 0x7fdb440bf9a0 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c9370 con 0x7fdb44037a00 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb440bf9a0 0x7fdb440bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb440bf9a0 0x7fdb440bfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35110/0 (socket says 172.21.15.94:35110) 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 -- 172.21.15.94:0/1365087798 learned_addr learned my addr 172.21.15.94:0/1365087798 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:15.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb50c31700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fdb44037de0 0x7fdb440c9aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56678/0 (socket says 172.21.15.94:56678) 2024-03-18T18:09:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51432700 1 --2- 172.21.15.94:0/1365087798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb44037a00 0x7fdb440cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 -- 172.21.15.94:0/1365087798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb44037a00 msgr2=0x7fdb440cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 --2- 172.21.15.94:0/1365087798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb44037a00 0x7fdb440cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 -- 172.21.15.94:0/1365087798 >> v1:172.21.15.94:6789/0 conn(0x7fdb44037de0 legacy=0x7fdb440c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 -- 172.21.15.94:0/1365087798 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44038d40 con 0x7fdb440bf9a0 2024-03-18T18:09:15.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb51c33700 1 --2- 172.21.15.94:0/1365087798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb440bf9a0 0x7fdb440bfe30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c04fdf0 tx=0x7fdb4c04f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7200aeaf4f356c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb43fff700 1 -- 172.21.15.94:0/1365087798 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c067100 con 0x7fdb440bf9a0 2024-03-18T18:09:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb43fff700 1 -- 172.21.15.94:0/1365087798 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c067260 con 0x7fdb440bf9a0 2024-03-18T18:09:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb43fff700 1 -- 172.21.15.94:0/1365087798 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c067810 con 0x7fdb440bf9a0 2024-03-18T18:09:15.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- 172.21.15.94:0/1365087798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb440bf9a0 msgr2=0x7fdb440bfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 --2- 172.21.15.94:0/1365087798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb440bf9a0 0x7fdb440bfe30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c04fdf0 tx=0x7fdb4c04f570 comp rx=0 tx=0).stop 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- 172.21.15.94:0/1365087798 shutdown_connections 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 --2- 172.21.15.94:0/1365087798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb440bf9a0 0x7fdb440bfe30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 --2- 172.21.15.94:0/1365087798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb44037a00 0x7fdb440cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- 172.21.15.94:0/1365087798 >> 172.21.15.94:0/1365087798 conn(0x7fdb4403ba70 msgr2=0x7fdb4403be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- 172.21.15.94:0/1365087798 shutdown_connections 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.624+0000 7fdb52434700 1 -- 172.21.15.94:0/1365087798 wait complete. 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 Processor -- start 2024-03-18T18:09:15.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- start start 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 0x7fdb4403d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb44037de0 0x7fdb4415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb440bf9a0 0x7fdb440bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4402d840 con 0x7fdb44037a00 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4402dd50 con 0x7fdb44037de0 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4402c7c0 con 0x7fdb440bf9a0 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 0x7fdb4403d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 0x7fdb4403d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35122/0 (socket says 172.21.15.94:35122) 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 -- 172.21.15.94:0/1405038048 learned_addr learned my addr 172.21.15.94:0/1405038048 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb50c31700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb44037de0 0x7fdb4415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51c33700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb440bf9a0 0x7fdb440bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 -- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb440bf9a0 msgr2=0x7fdb440bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb440bf9a0 0x7fdb440bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 -- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb44037de0 msgr2=0x7fdb4415f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb44037de0 0x7fdb4415f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 -- 172.21.15.94:0/1405038048 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c04ea40 con 0x7fdb44037a00 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51c33700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb440bf9a0 0x7fdb440bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb51432700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 0x7fdb4403d6d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800d800 tx=0x7fdb4800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480125f0 con 0x7fdb44037a00 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48012750 con 0x7fdb44037a00 2024-03-18T18:09:15.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4402caa0 con 0x7fdb44037a00 2024-03-18T18:09:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48012ac0 con 0x7fdb44037a00 2024-03-18T18:09:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4415f6f0 con 0x7fdb44037a00 2024-03-18T18:09:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb44006580 con 0x7fdb44037a00 2024-03-18T18:09:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.628+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdb48012c20 con 0x7fdb44037a00 2024-03-18T18:09:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.632+0000 7fdb41ffb700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdb30066730 0x7fdb30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.632+0000 7fdb50c31700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdb30066730 0x7fdb30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.632+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb48084430 con 0x7fdb44037a00 2024-03-18T18:09:15.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.632+0000 7fdb50c31700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdb30066730 0x7fdb30068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb440c31c0 tx=0x7fdb3c007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.636+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdb48051830 con 0x7fdb44037a00 2024-03-18T18:09:15.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.800+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb440cd620 con 0x7fdb30066730 2024-03-18T18:09:15.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.816+0000 7fdb41ffb700 1 -- 172.21.15.94:0/1405038048 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253669 (secure 0 0 0) 0x7fdb3c004890 con 0x7fdb30066730 2024-03-18T18:09:15.824 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:15.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdb30066730 msgr2=0x7fdb30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdb30066730 0x7fdb30068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb440c31c0 tx=0x7fdb3c007d70 comp rx=0 tx=0).stop 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 msgr2=0x7fdb4403d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 0x7fdb4403d6d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800d800 tx=0x7fdb4800dbc0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 shutdown_connections 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdb30066730 0x7fdb30068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb440bf9a0 0x7fdb440bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb44037de0 0x7fdb4415f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 --2- 172.21.15.94:0/1405038048 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb44037a00 0x7fdb4403d6d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 >> 172.21.15.94:0/1405038048 conn(0x7fdb4403ba70 msgr2=0x7fdb440c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 shutdown_connections 2024-03-18T18:09:15.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.824+0000 7fdb52434700 1 -- 172.21.15.94:0/1405038048 wait complete. 2024-03-18T18:09:15.829 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:15.841 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-18T18:09:14.559510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":235136,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739584,"statfs":{"total":773094113280,"available":772853334016,"internally_reserved":0,"allocated":2629632,"data_stored":1626280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835405+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:12.835405+0000","last_peered":"2024-03-18T18:09:12.835405+0000","last_clean":"2024-03-18T18:09:12.835405+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:12.835405+0000","last_undegraded":"2024-03-18T18:09:12.835405+0000","last_fullsized":"2024-03-18T18:09:12.835405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.845810+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:12.845810+0000","last_peered":"2024-03-18T18:09:12.845810+0000","last_clean":"2024-03-18T18:09:12.845810+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:12.845810+0000","last_undegraded":"2024-03-18T18:09:12.845810+0000","last_fullsized":"2024-03-18T18:09:12.845810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.849694+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:12.849694+0000","last_peered":"2024-03-18T18:09:12.849694+0000","last_clean":"2024-03-18T18:09:12.849694+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:12.849694+0000","last_undegraded":"2024-03-18T18:09:12.849694+0000","last_fullsized":"2024-03-18T18:09:12.849694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837215+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:12.837215+0000","last_peered":"2024-03-18T18:09:12.837215+0000","last_clean":"2024-03-18T18:09:12.837215+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:12.837215+0000","last_undegraded":"2024-03-18T18:09:12.837215+0000","last_fullsized":"2024-03-18T18:09:12.837215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.838298+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:12.838298+0000","last_peered":"2024-03-18T18:09:12.838298+0000","last_clean":"2024-03-18T18:09:12.838298+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:12.838298+0000","last_undegraded":"2024-03-18T18:09:12.838298+0000","last_fullsized":"2024-03-18T18:09:12.838298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833494+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:12.833494+0000","last_peered":"2024-03-18T18:09:12.833494+0000","last_clean":"2024-03-18T18:09:12.833494+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:12.833494+0000","last_undegraded":"2024-03-18T18:09:12.833494+0000","last_fullsized":"2024-03-18T18:09:12.833494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833467+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:12.833467+0000","last_peered":"2024-03-18T18:09:12.833467+0000","last_clean":"2024-03-18T18:09:12.833467+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:12.833467+0000","last_undegraded":"2024-03-18T18:09:12.833467+0000","last_fullsized":"2024-03-18T18:09:12.833467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833441+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:12.833441+0000","last_peered":"2024-03-18T18:09:12.833441+0000","last_clean":"2024-03-18T18:09:12.833441+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:12.833441+0000","last_undegraded":"2024-03-18T18:09:12.833441+0000","last_fullsized":"2024-03-18T18:09:12.833441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837222+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:12.837222+0000","last_peered":"2024-03-18T18:09:12.837222+0000","last_clean":"2024-03-18T18:09:12.837222+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:12.837222+0000","last_undegraded":"2024-03-18T18:09:12.837222+0000","last_fullsized":"2024-03-18T18:09:12.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837726+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:12.837726+0000","last_peered":"2024-03-18T18:09:12.837726+0000","last_clean":"2024-03-18T18:09:12.837726+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:12.837726+0000","last_undegraded":"2024-03-18T18:09:12.837726+0000","last_fullsized":"2024-03-18T18:09:12.837726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840122+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:12.840122+0000","last_peered":"2024-03-18T18:09:12.840122+0000","last_clean":"2024-03-18T18:09:12.840122+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:12.840122+0000","last_undegraded":"2024-03-18T18:09:12.840122+0000","last_fullsized":"2024-03-18T18:09:12.840122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820402+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:12.820402+0000","last_peered":"2024-03-18T18:09:12.820402+0000","last_clean":"2024-03-18T18:09:12.820402+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:12.820402+0000","last_undegraded":"2024-03-18T18:09:12.820402+0000","last_fullsized":"2024-03-18T18:09:12.820402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835017+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:12.835017+0000","last_peered":"2024-03-18T18:09:12.835017+0000","last_clean":"2024-03-18T18:09:12.835017+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:12.835017+0000","last_undegraded":"2024-03-18T18:09:12.835017+0000","last_fullsized":"2024-03-18T18:09:12.835017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851726+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:12.851726+0000","last_peered":"2024-03-18T18:09:12.851726+0000","last_clean":"2024-03-18T18:09:12.851726+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:12.851726+0000","last_undegraded":"2024-03-18T18:09:12.851726+0000","last_fullsized":"2024-03-18T18:09:12.851726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.843026+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:12.843026+0000","last_peered":"2024-03-18T18:09:12.843026+0000","last_clean":"2024-03-18T18:09:12.843026+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:12.843026+0000","last_undegraded":"2024-03-18T18:09:12.843026+0000","last_fullsized":"2024-03-18T18:09:12.843026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835417+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:12.835417+0000","last_peered":"2024-03-18T18:09:12.835417+0000","last_clean":"2024-03-18T18:09:12.835417+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:12.835417+0000","last_undegraded":"2024-03-18T18:09:12.835417+0000","last_fullsized":"2024-03-18T18:09:12.835417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":160,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T18:09:02.620766+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:02.620766+0000","last_peered":"2024-03-18T18:09:02.620766+0000","last_clean":"2024-03-18T18:09:02.620766+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:02.620766+0000","last_undegraded":"2024-03-18T18:09:02.620766+0000","last_fullsized":"2024-03-18T18:09:02.620766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851080+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:12.851080+0000","last_peered":"2024-03-18T18:09:12.851080+0000","last_clean":"2024-03-18T18:09:12.851080+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:12.851080+0000","last_undegraded":"2024-03-18T18:09:12.851080+0000","last_fullsized":"2024-03-18T18:09:12.851080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839841+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:12.839841+0000","last_peered":"2024-03-18T18:09:12.839841+0000","last_clean":"2024-03-18T18:09:12.839841+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:12.839841+0000","last_undegraded":"2024-03-18T18:09:12.839841+0000","last_fullsized":"2024-03-18T18:09:12.839841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834965+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:12.834965+0000","last_peered":"2024-03-18T18:09:12.834965+0000","last_clean":"2024-03-18T18:09:12.834965+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:12.834965+0000","last_undegraded":"2024-03-18T18:09:12.834965+0000","last_fullsized":"2024-03-18T18:09:12.834965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.832536+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:12.832536+0000","last_peered":"2024-03-18T18:09:12.832536+0000","last_clean":"2024-03-18T18:09:12.832536+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:12.832536+0000","last_undegraded":"2024-03-18T18:09:12.832536+0000","last_fullsized":"2024-03-18T18:09:12.832536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833573+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:12.833573+0000","last_peered":"2024-03-18T18:09:12.833573+0000","last_clean":"2024-03-18T18:09:12.833573+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:12.833573+0000","last_undegraded":"2024-03-18T18:09:12.833573+0000","last_fullsized":"2024-03-18T18:09:12.833573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834995+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:12.834995+0000","last_peered":"2024-03-18T18:09:12.834995+0000","last_clean":"2024-03-18T18:09:12.834995+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:12.834995+0000","last_undegraded":"2024-03-18T18:09:12.834995+0000","last_fullsized":"2024-03-18T18:09:12.834995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851751+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:12.851751+0000","last_peered":"2024-03-18T18:09:12.851751+0000","last_clean":"2024-03-18T18:09:12.851751+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:12.851751+0000","last_undegraded":"2024-03-18T18:09:12.851751+0000","last_fullsized":"2024-03-18T18:09:12.851751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837411+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:12.837411+0000","last_peered":"2024-03-18T18:09:12.837411+0000","last_clean":"2024-03-18T18:09:12.837411+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:12.837411+0000","last_undegraded":"2024-03-18T18:09:12.837411+0000","last_fullsized":"2024-03-18T18:09:12.837411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850617+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:12.850617+0000","last_peered":"2024-03-18T18:09:12.850617+0000","last_clean":"2024-03-18T18:09:12.850617+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:12.850617+0000","last_undegraded":"2024-03-18T18:09:12.850617+0000","last_fullsized":"2024-03-18T18:09:12.850617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837648+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:12.837648+0000","last_peered":"2024-03-18T18:09:12.837648+0000","last_clean":"2024-03-18T18:09:12.837648+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:12.837648+0000","last_undegraded":"2024-03-18T18:09:12.837648+0000","last_fullsized":"2024-03-18T18:09:12.837648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":641069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31284,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31284,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":71132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":660574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:15.845 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:15.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aab189700 1 Processor -- start 2024-03-18T18:09:15.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aab189700 1 -- start start 2024-03-18T18:09:15.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aab189700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0aa409ac60 0x7f0aa40b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aab189700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40b9be0 con 0x7f0aa40b8270 2024-03-18T18:09:15.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aab189700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40ba110 con 0x7f0aa4140b00 2024-03-18T18:09:15.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aab189700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa409b040 con 0x7f0aa409ac60 2024-03-18T18:09:15.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9986700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0aa40b8270 0x7f0aa41403f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56692/0 (socket says 172.21.15.94:56692) 2024-03-18T18:09:15.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9986700 1 -- 172.21.15.94:0/1825428905 learned_addr learned my addr 172.21.15.94:0/1825428905 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aaa187700 1 --2- 172.21.15.94:0/1825428905 >> v2:172.21.15.151:3300/0 conn(0x7f0aa409ac60 0x7f0aa40b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9185700 1 -- 172.21.15.94:0/1825428905 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209554082 0 0) 0x7f0aa40b9be0 con 0x7f0aa40b8270 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9185700 1 -- 172.21.15.94:0/1825428905 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a900035d0 con 0x7f0aa40b8270 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aaa187700 1 -- 172.21.15.94:0/1825428905 >> v1:172.21.15.151:6789/0 conn(0x7f0aa4140b00 legacy=0x7f0aa4150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aaa187700 1 -- 172.21.15.94:0/1825428905 >> v1:172.21.15.94:6789/0 conn(0x7f0aa40b8270 legacy=0x7f0aa41403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aaa187700 1 -- 172.21.15.94:0/1825428905 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40b9e30 con 0x7f0aa409ac60 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aaa187700 1 --2- 172.21.15.94:0/1825428905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa409ac60 0x7f0aa40b87c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009d90 tx=0x7f0a9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2605f5090a1d19e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9185700 1 -- 172.21.15.94:0/1825428905 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00e070 con 0x7f0aa409ac60 2024-03-18T18:09:15.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9185700 1 -- 172.21.15.94:0/1825428905 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00bb20 con 0x7f0aa409ac60 2024-03-18T18:09:15.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.956+0000 7f0aa9185700 1 -- 172.21.15.94:0/1825428905 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00be90 con 0x7f0aa409ac60 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 -- 172.21.15.94:0/1825428905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa409ac60 msgr2=0x7f0aa40b87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 --2- 172.21.15.94:0/1825428905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa409ac60 0x7f0aa40b87c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009d90 tx=0x7f0a9c00b330 comp rx=0 tx=0).stop 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 -- 172.21.15.94:0/1825428905 shutdown_connections 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 --2- 172.21.15.94:0/1825428905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa409ac60 0x7f0aa40b87c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 -- 172.21.15.94:0/1825428905 >> 172.21.15.94:0/1825428905 conn(0x7f0aa409dbf0 msgr2=0x7f0aa409dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 -- 172.21.15.94:0/1825428905 shutdown_connections 2024-03-18T18:09:15.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 -- 172.21.15.94:0/1825428905 wait complete. 2024-03-18T18:09:15.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 Processor -- start 2024-03-18T18:09:15.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.960+0000 7f0aab189700 1 -- start start 2024-03-18T18:09:15.966 INFO:tasks.ceph.mds.b.smithi151.stderr:2024-03-18T18:09:15.960+0000 7f1fd2be0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T18:09:15.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0aa409ac60 0x7f0aa40b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa40b8270 0x7f0aa41dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 0x7f0aa41df200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa41dc180 con 0x7f0aa4140b00 2024-03-18T18:09:15.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa41dbda0 con 0x7f0aa40b8270 2024-03-18T18:09:15.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4143750 con 0x7f0aa409ac60 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 0x7f0aa41df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa187700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0aa409ac60 0x7f0aa40b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aa9986700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa40b8270 0x7f0aa41dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 0x7f0aa41df200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35126/0 (socket says 172.21.15.94:35126) 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 -- 172.21.15.94:0/2037385351 learned_addr learned my addr 172.21.15.94:0/2037385351 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 -- 172.21.15.94:0/2037385351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0aa409ac60 msgr2=0x7f0aa40b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0aa409ac60 0x7f0aa40b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 -- 172.21.15.94:0/2037385351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa40b8270 msgr2=0x7f0aa41dc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa40b8270 0x7f0aa41dc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 -- 172.21.15.94:0/2037385351 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c009a70 con 0x7f0aa4140b00 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aaa988700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 0x7f0aa41df200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c480 tx=0x7f0aa000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00052d0 con 0x7f0aa4140b00 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000ce90 con 0x7f0aa4140b00 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa40b5f30 con 0x7f0aa4140b00 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00036a0 con 0x7f0aa4140b00 2024-03-18T18:09:15.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa41dcae0 con 0x7f0aa4140b00 2024-03-18T18:09:15.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.964+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4067620 con 0x7f0aa4140b00 2024-03-18T18:09:15.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.968+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0aa0003800 con 0x7f0aa4140b00 2024-03-18T18:09:15.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.968+0000 7f0a9affd700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0a88066730 0x7f0a88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:15.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.968+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0aa0083480 con 0x7f0aa4140b00 2024-03-18T18:09:15.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.968+0000 7f0aaa187700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0a88066730 0x7f0a88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:15.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.968+0000 7f0aaa187700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0a88066730 0x7f0a88068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00b370 tx=0x7f0a9c011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:15.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:15.972+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0aa00507f0 con 0x7f0aa4140b00 2024-03-18T18:09:16.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.144+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0aa41dc2c0 con 0x7f0a88066730 2024-03-18T18:09:16.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.156+0000 7f0a9affd700 1 -- 172.21.15.94:0/2037385351 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253669 (secure 0 0 0) 0x7f0aa41dc2c0 con 0x7f0a88066730 2024-03-18T18:09:16.165 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0a88066730 msgr2=0x7f0a88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0a88066730 0x7f0a88068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00b370 tx=0x7f0a9c011000 comp rx=0 tx=0).stop 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 msgr2=0x7f0aa41df200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 0x7f0aa41df200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c480 tx=0x7f0aa000c790 comp rx=0 tx=0).stop 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 shutdown_connections 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0a88066730 0x7f0a88068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0aa4140b00 0x7f0aa41df200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa40b8270 0x7f0aa41dc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 --2- 172.21.15.94:0/2037385351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0aa409ac60 0x7f0aa40b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 >> 172.21.15.94:0/2037385351 conn(0x7f0aa409dbf0 msgr2=0x7f0aa40b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:16.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 shutdown_connections 2024-03-18T18:09:16.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.160+0000 7f0aab189700 1 -- 172.21.15.94:0/2037385351 wait complete. 2024-03-18T18:09:16.168 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:16.180 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-18T18:09:14.559510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":235136,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739584,"statfs":{"total":773094113280,"available":772853334016,"internally_reserved":0,"allocated":2629632,"data_stored":1626280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835405+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:12.835405+0000","last_peered":"2024-03-18T18:09:12.835405+0000","last_clean":"2024-03-18T18:09:12.835405+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:12.835405+0000","last_undegraded":"2024-03-18T18:09:12.835405+0000","last_fullsized":"2024-03-18T18:09:12.835405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.845810+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:12.845810+0000","last_peered":"2024-03-18T18:09:12.845810+0000","last_clean":"2024-03-18T18:09:12.845810+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:12.845810+0000","last_undegraded":"2024-03-18T18:09:12.845810+0000","last_fullsized":"2024-03-18T18:09:12.845810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.849694+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:12.849694+0000","last_peered":"2024-03-18T18:09:12.849694+0000","last_clean":"2024-03-18T18:09:12.849694+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:12.849694+0000","last_undegraded":"2024-03-18T18:09:12.849694+0000","last_fullsized":"2024-03-18T18:09:12.849694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837215+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:12.837215+0000","last_peered":"2024-03-18T18:09:12.837215+0000","last_clean":"2024-03-18T18:09:12.837215+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:12.837215+0000","last_undegraded":"2024-03-18T18:09:12.837215+0000","last_fullsized":"2024-03-18T18:09:12.837215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.838298+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:12.838298+0000","last_peered":"2024-03-18T18:09:12.838298+0000","last_clean":"2024-03-18T18:09:12.838298+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:12.838298+0000","last_undegraded":"2024-03-18T18:09:12.838298+0000","last_fullsized":"2024-03-18T18:09:12.838298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833494+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:12.833494+0000","last_peered":"2024-03-18T18:09:12.833494+0000","last_clean":"2024-03-18T18:09:12.833494+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:12.833494+0000","last_undegraded":"2024-03-18T18:09:12.833494+0000","last_fullsized":"2024-03-18T18:09:12.833494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833467+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:12.833467+0000","last_peered":"2024-03-18T18:09:12.833467+0000","last_clean":"2024-03-18T18:09:12.833467+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:12.833467+0000","last_undegraded":"2024-03-18T18:09:12.833467+0000","last_fullsized":"2024-03-18T18:09:12.833467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833441+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:12.833441+0000","last_peered":"2024-03-18T18:09:12.833441+0000","last_clean":"2024-03-18T18:09:12.833441+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:12.833441+0000","last_undegraded":"2024-03-18T18:09:12.833441+0000","last_fullsized":"2024-03-18T18:09:12.833441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837222+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:12.837222+0000","last_peered":"2024-03-18T18:09:12.837222+0000","last_clean":"2024-03-18T18:09:12.837222+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:12.837222+0000","last_undegraded":"2024-03-18T18:09:12.837222+0000","last_fullsized":"2024-03-18T18:09:12.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837726+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:12.837726+0000","last_peered":"2024-03-18T18:09:12.837726+0000","last_clean":"2024-03-18T18:09:12.837726+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:12.837726+0000","last_undegraded":"2024-03-18T18:09:12.837726+0000","last_fullsized":"2024-03-18T18:09:12.837726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840122+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:12.840122+0000","last_peered":"2024-03-18T18:09:12.840122+0000","last_clean":"2024-03-18T18:09:12.840122+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:12.840122+0000","last_undegraded":"2024-03-18T18:09:12.840122+0000","last_fullsized":"2024-03-18T18:09:12.840122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820402+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:12.820402+0000","last_peered":"2024-03-18T18:09:12.820402+0000","last_clean":"2024-03-18T18:09:12.820402+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:12.820402+0000","last_undegraded":"2024-03-18T18:09:12.820402+0000","last_fullsized":"2024-03-18T18:09:12.820402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835017+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:12.835017+0000","last_peered":"2024-03-18T18:09:12.835017+0000","last_clean":"2024-03-18T18:09:12.835017+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:12.835017+0000","last_undegraded":"2024-03-18T18:09:12.835017+0000","last_fullsized":"2024-03-18T18:09:12.835017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851726+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:12.851726+0000","last_peered":"2024-03-18T18:09:12.851726+0000","last_clean":"2024-03-18T18:09:12.851726+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:12.851726+0000","last_undegraded":"2024-03-18T18:09:12.851726+0000","last_fullsized":"2024-03-18T18:09:12.851726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.843026+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:12.843026+0000","last_peered":"2024-03-18T18:09:12.843026+0000","last_clean":"2024-03-18T18:09:12.843026+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:12.843026+0000","last_undegraded":"2024-03-18T18:09:12.843026+0000","last_fullsized":"2024-03-18T18:09:12.843026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835417+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:12.835417+0000","last_peered":"2024-03-18T18:09:12.835417+0000","last_clean":"2024-03-18T18:09:12.835417+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:12.835417+0000","last_undegraded":"2024-03-18T18:09:12.835417+0000","last_fullsized":"2024-03-18T18:09:12.835417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":160,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T18:09:02.620766+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:02.620766+0000","last_peered":"2024-03-18T18:09:02.620766+0000","last_clean":"2024-03-18T18:09:02.620766+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:02.620766+0000","last_undegraded":"2024-03-18T18:09:02.620766+0000","last_fullsized":"2024-03-18T18:09:02.620766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851080+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:12.851080+0000","last_peered":"2024-03-18T18:09:12.851080+0000","last_clean":"2024-03-18T18:09:12.851080+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:12.851080+0000","last_undegraded":"2024-03-18T18:09:12.851080+0000","last_fullsized":"2024-03-18T18:09:12.851080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839841+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:12.839841+0000","last_peered":"2024-03-18T18:09:12.839841+0000","last_clean":"2024-03-18T18:09:12.839841+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:12.839841+0000","last_undegraded":"2024-03-18T18:09:12.839841+0000","last_fullsized":"2024-03-18T18:09:12.839841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834965+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:12.834965+0000","last_peered":"2024-03-18T18:09:12.834965+0000","last_clean":"2024-03-18T18:09:12.834965+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:12.834965+0000","last_undegraded":"2024-03-18T18:09:12.834965+0000","last_fullsized":"2024-03-18T18:09:12.834965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.832536+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:12.832536+0000","last_peered":"2024-03-18T18:09:12.832536+0000","last_clean":"2024-03-18T18:09:12.832536+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:12.832536+0000","last_undegraded":"2024-03-18T18:09:12.832536+0000","last_fullsized":"2024-03-18T18:09:12.832536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833573+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:12.833573+0000","last_peered":"2024-03-18T18:09:12.833573+0000","last_clean":"2024-03-18T18:09:12.833573+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:12.833573+0000","last_undegraded":"2024-03-18T18:09:12.833573+0000","last_fullsized":"2024-03-18T18:09:12.833573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834995+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:12.834995+0000","last_peered":"2024-03-18T18:09:12.834995+0000","last_clean":"2024-03-18T18:09:12.834995+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:12.834995+0000","last_undegraded":"2024-03-18T18:09:12.834995+0000","last_fullsized":"2024-03-18T18:09:12.834995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851751+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:12.851751+0000","last_peered":"2024-03-18T18:09:12.851751+0000","last_clean":"2024-03-18T18:09:12.851751+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:12.851751+0000","last_undegraded":"2024-03-18T18:09:12.851751+0000","last_fullsized":"2024-03-18T18:09:12.851751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837411+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:12.837411+0000","last_peered":"2024-03-18T18:09:12.837411+0000","last_clean":"2024-03-18T18:09:12.837411+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:12.837411+0000","last_undegraded":"2024-03-18T18:09:12.837411+0000","last_fullsized":"2024-03-18T18:09:12.837411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850617+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:12.850617+0000","last_peered":"2024-03-18T18:09:12.850617+0000","last_clean":"2024-03-18T18:09:12.850617+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:12.850617+0000","last_undegraded":"2024-03-18T18:09:12.850617+0000","last_fullsized":"2024-03-18T18:09:12.850617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837648+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:12.837648+0000","last_peered":"2024-03-18T18:09:12.837648+0000","last_clean":"2024-03-18T18:09:12.837648+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:12.837648+0000","last_undegraded":"2024-03-18T18:09:12.837648+0000","last_fullsized":"2024-03-18T18:09:12.837648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":641069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31284,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31284,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":71132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":660574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:16.184 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 Processor -- start 2024-03-18T18:09:16.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- start start 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d40b1000 0x7f36d414e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d40af790 con 0x7f36d414e9c0 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d406e700 con 0x7f36d414e0a0 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40af210 con 0x7f36d40b1000 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d37fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f36d414e9c0 0x7f36d4144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56706/0 (socket says 172.21.15.94:56706) 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d37fe700 1 -- 172.21.15.94:0/139136145 learned_addr learned my addr 172.21.15.94:0/139136145 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:16.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d27fc700 1 --2- 172.21.15.94:0/139136145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d40b1000 0x7f36d414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d1ffb700 1 -- 172.21.15.94:0/139136145 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685280598 0 0) 0x7f36d40af790 con 0x7f36d414e9c0 2024-03-18T18:09:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d27fc700 1 -- 172.21.15.94:0/139136145 >> v1:172.21.15.151:6789/0 conn(0x7f36d414e0a0 legacy=0x7f36d40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d27fc700 1 -- 172.21.15.94:0/139136145 >> v1:172.21.15.94:6789/0 conn(0x7f36d414e9c0 legacy=0x7f36d4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d27fc700 1 -- 172.21.15.94:0/139136145 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40af420 con 0x7f36d40b1000 2024-03-18T18:09:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d27fc700 1 --2- 172.21.15.94:0/139136145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d40b1000 0x7f36d414e480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009dc0 tx=0x7f36cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a31663eb99fbba server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d1ffb700 1 -- 172.21.15.94:0/139136145 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00e070 con 0x7f36d40b1000 2024-03-18T18:09:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d1ffb700 1 -- 172.21.15.94:0/139136145 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00bad0 con 0x7f36d40b1000 2024-03-18T18:09:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d1ffb700 1 -- 172.21.15.94:0/139136145 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00be80 con 0x7f36d40b1000 2024-03-18T18:09:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- 172.21.15.94:0/139136145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d40b1000 msgr2=0x7f36d414e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 --2- 172.21.15.94:0/139136145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d40b1000 0x7f36d414e480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009dc0 tx=0x7f36cc00b330 comp rx=0 tx=0).stop 2024-03-18T18:09:16.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- 172.21.15.94:0/139136145 shutdown_connections 2024-03-18T18:09:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 --2- 172.21.15.94:0/139136145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d40b1000 0x7f36d414e480 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- 172.21.15.94:0/139136145 >> 172.21.15.94:0/139136145 conn(0x7f36d40b7a20 msgr2=0x7f36d40b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- 172.21.15.94:0/139136145 shutdown_connections 2024-03-18T18:09:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.292+0000 7f36d3fff700 1 -- 172.21.15.94:0/139136145 wait complete. 2024-03-18T18:09:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 Processor -- start 2024-03-18T18:09:16.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 -- start start 2024-03-18T18:09:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d414e0a0 0x7f36d414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36d414e9c0 0x7f36d41d4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 0x7f36d41458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4147a70 con 0x7f36d4145460 2024-03-18T18:09:16.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41d47a0 con 0x7f36d414e9c0 2024-03-18T18:09:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4145e30 con 0x7f36d414e0a0 2024-03-18T18:09:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d37fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 0x7f36d41458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d37fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 0x7f36d41458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35134/0 (socket says 172.21.15.94:35134) 2024-03-18T18:09:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d37fe700 1 -- 172.21.15.94:0/229338522 learned_addr learned my addr 172.21.15.94:0/229338522 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36d414e9c0 0x7f36d41d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d2ffd700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d414e0a0 0x7f36d414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 -- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d414e0a0 msgr2=0x7f36d414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d414e0a0 0x7f36d414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 -- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 msgr2=0x7f36d41458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 0x7f36d41458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 -- 172.21.15.94:0/229338522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc009a70 con 0x7f36d414e9c0 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d37fe700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 0x7f36d41458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d27fc700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36d414e9c0 0x7f36d41d4260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36cc015000 tx=0x7f36cc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc012430 con 0x7f36d414e9c0 2024-03-18T18:09:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc0125d0 con 0x7f36d414e9c0 2024-03-18T18:09:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d41d49e0 con 0x7f36d414e9c0 2024-03-18T18:09:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc012980 con 0x7f36d414e9c0 2024-03-18T18:09:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.296+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d4147f60 con 0x7f36d414e9c0 2024-03-18T18:09:16.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.300+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d40b4320 con 0x7f36d414e9c0 2024-03-18T18:09:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.300+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f36cc012ae0 con 0x7f36d414e9c0 2024-03-18T18:09:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.300+0000 7f36cb7fe700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f36b8066730 0x7f36b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.300+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36cc086340 con 0x7f36d414e9c0 2024-03-18T18:09:16.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.300+0000 7f36d2ffd700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f36b8066730 0x7f36b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.300+0000 7f36d2ffd700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f36b8066730 0x7f36b8068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36c4007fd0 tx=0x7f36c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.313 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.308+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f36cc053940 con 0x7f36d414e9c0 2024-03-18T18:09:16.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.476+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36d4074440 con 0x7f36b8066730 2024-03-18T18:09:16.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.484+0000 7f36cb7fe700 1 -- 172.21.15.94:0/229338522 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253669 (secure 0 0 0) 0x7f36d4074440 con 0x7f36b8066730 2024-03-18T18:09:16.490 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:16.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f36b8066730 msgr2=0x7f36b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f36b8066730 0x7f36b8068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36c4007fd0 tx=0x7f36c4009040 comp rx=0 tx=0).stop 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36d414e9c0 msgr2=0x7f36d41d4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36d414e9c0 0x7f36d41d4260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36cc015000 tx=0x7f36cc004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 shutdown_connections 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f36b8066730 0x7f36b8068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f36d4145460 0x7f36d41458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36d414e9c0 0x7f36d41d4260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 --2- 172.21.15.94:0/229338522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36d414e0a0 0x7f36d414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 >> 172.21.15.94:0/229338522 conn(0x7f36d40b7a20 msgr2=0x7f36d40b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 shutdown_connections 2024-03-18T18:09:16.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.488+0000 7f36d3fff700 1 -- 172.21.15.94:0/229338522 wait complete. 2024-03-18T18:09:16.494 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:16.506 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-18T18:09:14.559510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":235136,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739584,"statfs":{"total":773094113280,"available":772853334016,"internally_reserved":0,"allocated":2629632,"data_stored":1626280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001339"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835405+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:12.835405+0000","last_peered":"2024-03-18T18:09:12.835405+0000","last_clean":"2024-03-18T18:09:12.835405+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:12.835405+0000","last_undegraded":"2024-03-18T18:09:12.835405+0000","last_fullsized":"2024-03-18T18:09:12.835405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.845810+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:12.845810+0000","last_peered":"2024-03-18T18:09:12.845810+0000","last_clean":"2024-03-18T18:09:12.845810+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:12.845810+0000","last_undegraded":"2024-03-18T18:09:12.845810+0000","last_fullsized":"2024-03-18T18:09:12.845810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.849694+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:12.849694+0000","last_peered":"2024-03-18T18:09:12.849694+0000","last_clean":"2024-03-18T18:09:12.849694+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:12.849694+0000","last_undegraded":"2024-03-18T18:09:12.849694+0000","last_fullsized":"2024-03-18T18:09:12.849694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837215+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:12.837215+0000","last_peered":"2024-03-18T18:09:12.837215+0000","last_clean":"2024-03-18T18:09:12.837215+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:12.837215+0000","last_undegraded":"2024-03-18T18:09:12.837215+0000","last_fullsized":"2024-03-18T18:09:12.837215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.838298+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:12.838298+0000","last_peered":"2024-03-18T18:09:12.838298+0000","last_clean":"2024-03-18T18:09:12.838298+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:12.838298+0000","last_undegraded":"2024-03-18T18:09:12.838298+0000","last_fullsized":"2024-03-18T18:09:12.838298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833494+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:12.833494+0000","last_peered":"2024-03-18T18:09:12.833494+0000","last_clean":"2024-03-18T18:09:12.833494+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:12.833494+0000","last_undegraded":"2024-03-18T18:09:12.833494+0000","last_fullsized":"2024-03-18T18:09:12.833494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833467+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:12.833467+0000","last_peered":"2024-03-18T18:09:12.833467+0000","last_clean":"2024-03-18T18:09:12.833467+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:12.833467+0000","last_undegraded":"2024-03-18T18:09:12.833467+0000","last_fullsized":"2024-03-18T18:09:12.833467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833441+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:12.833441+0000","last_peered":"2024-03-18T18:09:12.833441+0000","last_clean":"2024-03-18T18:09:12.833441+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:12.833441+0000","last_undegraded":"2024-03-18T18:09:12.833441+0000","last_fullsized":"2024-03-18T18:09:12.833441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837222+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:12.837222+0000","last_peered":"2024-03-18T18:09:12.837222+0000","last_clean":"2024-03-18T18:09:12.837222+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:12.837222+0000","last_undegraded":"2024-03-18T18:09:12.837222+0000","last_fullsized":"2024-03-18T18:09:12.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837726+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:12.837726+0000","last_peered":"2024-03-18T18:09:12.837726+0000","last_clean":"2024-03-18T18:09:12.837726+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:12.837726+0000","last_undegraded":"2024-03-18T18:09:12.837726+0000","last_fullsized":"2024-03-18T18:09:12.837726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840122+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:12.840122+0000","last_peered":"2024-03-18T18:09:12.840122+0000","last_clean":"2024-03-18T18:09:12.840122+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:12.840122+0000","last_undegraded":"2024-03-18T18:09:12.840122+0000","last_fullsized":"2024-03-18T18:09:12.840122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820402+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:12.820402+0000","last_peered":"2024-03-18T18:09:12.820402+0000","last_clean":"2024-03-18T18:09:12.820402+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:12.820402+0000","last_undegraded":"2024-03-18T18:09:12.820402+0000","last_fullsized":"2024-03-18T18:09:12.820402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835017+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:12.835017+0000","last_peered":"2024-03-18T18:09:12.835017+0000","last_clean":"2024-03-18T18:09:12.835017+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:12.835017+0000","last_undegraded":"2024-03-18T18:09:12.835017+0000","last_fullsized":"2024-03-18T18:09:12.835017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851726+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:12.851726+0000","last_peered":"2024-03-18T18:09:12.851726+0000","last_clean":"2024-03-18T18:09:12.851726+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:12.851726+0000","last_undegraded":"2024-03-18T18:09:12.851726+0000","last_fullsized":"2024-03-18T18:09:12.851726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.843026+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:12.843026+0000","last_peered":"2024-03-18T18:09:12.843026+0000","last_clean":"2024-03-18T18:09:12.843026+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:12.843026+0000","last_undegraded":"2024-03-18T18:09:12.843026+0000","last_fullsized":"2024-03-18T18:09:12.843026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835417+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:12.835417+0000","last_peered":"2024-03-18T18:09:12.835417+0000","last_clean":"2024-03-18T18:09:12.835417+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:12.835417+0000","last_undegraded":"2024-03-18T18:09:12.835417+0000","last_fullsized":"2024-03-18T18:09:12.835417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":160,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T18:09:02.620766+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:02.620766+0000","last_peered":"2024-03-18T18:09:02.620766+0000","last_clean":"2024-03-18T18:09:02.620766+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:02.620766+0000","last_undegraded":"2024-03-18T18:09:02.620766+0000","last_fullsized":"2024-03-18T18:09:02.620766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851080+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:12.851080+0000","last_peered":"2024-03-18T18:09:12.851080+0000","last_clean":"2024-03-18T18:09:12.851080+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:12.851080+0000","last_undegraded":"2024-03-18T18:09:12.851080+0000","last_fullsized":"2024-03-18T18:09:12.851080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839841+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:12.839841+0000","last_peered":"2024-03-18T18:09:12.839841+0000","last_clean":"2024-03-18T18:09:12.839841+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:12.839841+0000","last_undegraded":"2024-03-18T18:09:12.839841+0000","last_fullsized":"2024-03-18T18:09:12.839841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834965+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:12.834965+0000","last_peered":"2024-03-18T18:09:12.834965+0000","last_clean":"2024-03-18T18:09:12.834965+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:12.834965+0000","last_undegraded":"2024-03-18T18:09:12.834965+0000","last_fullsized":"2024-03-18T18:09:12.834965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.832536+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:12.832536+0000","last_peered":"2024-03-18T18:09:12.832536+0000","last_clean":"2024-03-18T18:09:12.832536+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:12.832536+0000","last_undegraded":"2024-03-18T18:09:12.832536+0000","last_fullsized":"2024-03-18T18:09:12.832536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833573+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:12.833573+0000","last_peered":"2024-03-18T18:09:12.833573+0000","last_clean":"2024-03-18T18:09:12.833573+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:12.833573+0000","last_undegraded":"2024-03-18T18:09:12.833573+0000","last_fullsized":"2024-03-18T18:09:12.833573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834995+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:12.834995+0000","last_peered":"2024-03-18T18:09:12.834995+0000","last_clean":"2024-03-18T18:09:12.834995+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:12.834995+0000","last_undegraded":"2024-03-18T18:09:12.834995+0000","last_fullsized":"2024-03-18T18:09:12.834995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:12.416688+0000","last_change":"2024-03-18T18:09:12.416688+0000","last_active":"2024-03-18T18:09:12.416688+0000","last_peered":"2024-03-18T18:09:12.416688+0000","last_clean":"2024-03-18T18:09:12.416688+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:12.416688+0000","last_undegraded":"2024-03-18T18:09:12.416688+0000","last_fullsized":"2024-03-18T18:09:12.416688+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T18:09:11.405580+0000","last_change":"2024-03-18T18:09:11.405580+0000","last_active":"2024-03-18T18:09:11.405580+0000","last_peered":"2024-03-18T18:09:11.405580+0000","last_clean":"2024-03-18T18:09:11.405580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T18:09:11.405580+0000","last_undegraded":"2024-03-18T18:09:11.405580+0000","last_fullsized":"2024-03-18T18:09:11.405580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851751+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:12.851751+0000","last_peered":"2024-03-18T18:09:12.851751+0000","last_clean":"2024-03-18T18:09:12.851751+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:12.851751+0000","last_undegraded":"2024-03-18T18:09:12.851751+0000","last_fullsized":"2024-03-18T18:09:12.851751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837411+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:12.837411+0000","last_peered":"2024-03-18T18:09:12.837411+0000","last_clean":"2024-03-18T18:09:12.837411+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:12.837411+0000","last_undegraded":"2024-03-18T18:09:12.837411+0000","last_fullsized":"2024-03-18T18:09:12.837411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850617+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:12.850617+0000","last_peered":"2024-03-18T18:09:12.850617+0000","last_clean":"2024-03-18T18:09:12.850617+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:12.850617+0000","last_undegraded":"2024-03-18T18:09:12.850617+0000","last_fullsized":"2024-03-18T18:09:12.850617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837648+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:12.837648+0000","last_peered":"2024-03-18T18:09:12.837648+0000","last_clean":"2024-03-18T18:09:12.837648+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:12.837648+0000","last_undegraded":"2024-03-18T18:09:12.837648+0000","last_fullsized":"2024-03-18T18:09:12.837648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":42,"acting":42,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476741,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":761856,"data_stored":641069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31284,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31284,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":167936,"data_stored":50701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":71132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":660574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-03-18T18:09:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-03-18T18:09:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-03-18T18:09:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-03-18T18:09:16.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-03-18T18:09:16.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-03-18T18:09:16.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-03-18T18:09:16.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-03-18T18:09:16.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-03-18T18:09:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-03-18T18:09:16.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-03-18T18:09:16.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-03-18T18:09:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-03-18T18:09:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:12.416688+0000', 'last_change': '2024-03-18T18:09:12.416688+0000', 'last_active': '2024-03-18T18:09:12.416688+0000', 'last_peered': '2024-03-18T18:09:12.416688+0000', 'last_clean': '2024-03-18T18:09:12.416688+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:12.416688+0000', 'last_undegraded': '2024-03-18T18:09:12.416688+0000', 'last_fullsized': '2024-03-18T18:09:12.416688+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:12.416688+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-03-18T18:09:16.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T18:09:11.405580+0000', 'last_change': '2024-03-18T18:09:11.405580+0000', 'last_active': '2024-03-18T18:09:11.405580+0000', 'last_peered': '2024-03-18T18:09:11.405580+0000', 'last_clean': '2024-03-18T18:09:11.405580+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T18:09:11.405580+0000', 'last_undegraded': '2024-03-18T18:09:11.405580+0000', 'last_fullsized': '2024-03-18T18:09:11.405580+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'last_clean_scrub_stamp': '2024-03-18T18:09:11.405580+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T18:09:16.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-18T18:09:16.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.624+0000 7f8dbeae8700 1 Processor -- start 2024-03-18T18:09:16.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.624+0000 7f8dbeae8700 1 -- start start 2024-03-18T18:09:16.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8db813e210 0x7f8db813e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db8070560 con 0x7f8db80b13a0 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db80b3790 con 0x7f8db813e210 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db80b1780 con 0x7f8db814cbf0 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8db813e210 0x7f8db813e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8db813e210 0x7f8db813e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35148/0 (socket says 172.21.15.94:35148) 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 -- 172.21.15.94:0/1409655092 learned_addr learned my addr 172.21.15.94:0/1409655092 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 -- 172.21.15.94:0/1409655092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 msgr2=0x7f8db814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 --2- 172.21.15.94:0/1409655092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 -- 172.21.15.94:0/1409655092 >> v1:172.21.15.94:6789/0 conn(0x7f8db80b13a0 legacy=0x7f8db8144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 -- 172.21.15.94:0/1409655092 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80b3a30 con 0x7f8db813e210 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbd2e5700 1 --2- 172.21.15.94:0/1409655092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db813e210 0x7f8db813e670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009910 tx=0x7f8da8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28edc0cb7e628a9b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbcae4700 1 -- 172.21.15.94:0/1409655092 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800ba60 con 0x7f8db813e210 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbcae4700 1 -- 172.21.15.94:0/1409655092 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da800bbc0 con 0x7f8db813e210 2024-03-18T18:09:16.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbcae4700 1 -- 172.21.15.94:0/1409655092 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8009e60 con 0x7f8db813e210 2024-03-18T18:09:16.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- 172.21.15.94:0/1409655092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db813e210 msgr2=0x7f8db813e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/1409655092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db813e210 0x7f8db813e670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009910 tx=0x7f8da8009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:16.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- 172.21.15.94:0/1409655092 shutdown_connections 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/1409655092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/1409655092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db813e210 0x7f8db813e670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- 172.21.15.94:0/1409655092 >> 172.21.15.94:0/1409655092 conn(0x7f8db80b7a20 msgr2=0x7f8db80b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- 172.21.15.94:0/1409655092 shutdown_connections 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- 172.21.15.94:0/1409655092 wait complete. 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 Processor -- start 2024-03-18T18:09:16.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.628+0000 7f8dbeae8700 1 -- start start 2024-03-18T18:09:16.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 0x7f8db8136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db813e210 0x7f8db8142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db8135fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81428a0 con 0x7f8db80b13a0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81421a0 con 0x7f8db813e210 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81424c0 con 0x7f8db814cbf0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 0x7f8db8136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 0x7f8db8136f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35156/0 (socket says 172.21.15.94:35156) 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 -- 172.21.15.94:0/3142452695 learned_addr learned my addr 172.21.15.94:0/3142452695 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbd2e5700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db813e210 0x7f8db8142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbe2e7700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db8135fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 -- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 msgr2=0x7f8db8135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db8135fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 -- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db813e210 msgr2=0x7f8db8142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db813e210 0x7f8db8142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 -- 172.21.15.94:0/3142452695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8009570 con 0x7f8db80b13a0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbdae6700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 0x7f8db8136f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c4e0 tx=0x7f8dac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0052d0 con 0x7f8db80b13a0 2024-03-18T18:09:16.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac005430 con 0x7f8db80b13a0 2024-03-18T18:09:16.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db81375e0 con 0x7f8db80b13a0 2024-03-18T18:09:16.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0055a0 con 0x7f8db80b13a0 2024-03-18T18:09:16.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db8134a30 con 0x7f8db80b13a0 2024-03-18T18:09:16.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.632+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db81429e0 con 0x7f8db80b13a0 2024-03-18T18:09:16.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.636+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8dac003900 con 0x7f8db80b13a0 2024-03-18T18:09:16.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.636+0000 7f8db67fc700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8da4066730 0x7f8da4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.636+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dac083780 con 0x7f8db80b13a0 2024-03-18T18:09:16.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.636+0000 7f8dbd2e5700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8da4066730 0x7f8da4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.636+0000 7f8dbd2e5700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8da4066730 0x7f8da4068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009c60 tx=0x7f8da8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.640+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8dac050b60 con 0x7f8db80b13a0 2024-03-18T18:09:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8db81429e0 con 0x7f8db80b13a0 2024-03-18T18:09:16.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8db67fc700 1 -- 172.21.15.94:0/3142452695 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7f8db81429e0 con 0x7f8db80b13a0 2024-03-18T18:09:16.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:16.875 INFO:teuthology.orchestra.run.smithi094.stdout:{"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1710785339,"num_in_osds":8,"osd_in_since":1710785330,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":241057792,"bytes_avail":772853055488,"bytes_total":773094113280,"write_bytes_sec":2787,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4291}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-18T18:08:47.369027+0000","services":{}},"progress_events":{}} 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8da4066730 msgr2=0x7f8da4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8da4066730 0x7f8da4068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009c60 tx=0x7f8da8008030 comp rx=0 tx=0).stop 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 msgr2=0x7f8db8136f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 0x7f8db8136f50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c4e0 tx=0x7f8dac00c7f0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 shutdown_connections 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8da4066730 0x7f8da4068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db814cbf0 0x7f8db8135fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db813e210 0x7f8db8142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 --2- 172.21.15.94:0/3142452695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db80b13a0 0x7f8db8136f50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 >> 172.21.15.94:0/3142452695 conn(0x7f8db80b7a20 msgr2=0x7f8db80b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:16.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 shutdown_connections 2024-03-18T18:09:16.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.872+0000 7f8dbeae8700 1 -- 172.21.15.94:0/3142452695 wait complete. 2024-03-18T18:09:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-18T18:09:16.890 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:16.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 Processor -- start 2024-03-18T18:09:16.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 -- start start 2024-03-18T18:09:16.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d9813e210 0x7f6d9813e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6d9814cbf0 0x7f6d9814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:16.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d98070560 con 0x7f6d980b13a0 2024-03-18T18:09:16.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980b3790 con 0x7f6d9813e210 2024-03-18T18:09:16.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e99b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980b1780 con 0x7f6d9814cbf0 2024-03-18T18:09:16.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d9813e210 0x7f6d9813e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6d9813e210 0x7f6d9813e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35162/0 (socket says 172.21.15.94:35162) 2024-03-18T18:09:16.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 -- 172.21.15.94:0/3118075619 learned_addr learned my addr 172.21.15.94:0/3118075619 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:16.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9e19a700 1 --2- 172.21.15.94:0/3118075619 >> v2:172.21.15.151:3300/0 conn(0x7f6d9814cbf0 0x7f6d9814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 -- 172.21.15.94:0/3118075619 >> v2:172.21.15.151:3300/0 conn(0x7f6d9814cbf0 msgr2=0x7f6d9814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 --2- 172.21.15.94:0/3118075619 >> v2:172.21.15.151:3300/0 conn(0x7f6d9814cbf0 0x7f6d9814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 -- 172.21.15.94:0/3118075619 >> v1:172.21.15.151:6789/0 conn(0x7f6d980b13a0 legacy=0x7f6d98144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.992+0000 7f6d9d198700 1 -- 172.21.15.94:0/3118075619 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980b3a30 con 0x7f6d9813e210 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9d198700 1 --2- 172.21.15.94:0/3118075619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d9813e670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d9806ec30 tx=0x7f6d9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80535f34c1d3b1d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9c997700 1 -- 172.21.15.94:0/3118075619 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9000e070 con 0x7f6d9813e210 2024-03-18T18:09:16.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9c997700 1 -- 172.21.15.94:0/3118075619 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9000b910 con 0x7f6d9813e210 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9c997700 1 -- 172.21.15.94:0/3118075619 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9000bcc0 con 0x7f6d9813e210 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 -- 172.21.15.94:0/3118075619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 msgr2=0x7f6d9813e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/3118075619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d9813e670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d9806ec30 tx=0x7f6d9000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 -- 172.21.15.94:0/3118075619 shutdown_connections 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/3118075619 >> v2:172.21.15.151:3300/0 conn(0x7f6d9814cbf0 0x7f6d9814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/3118075619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d9813e670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 -- 172.21.15.94:0/3118075619 >> 172.21.15.94:0/3118075619 conn(0x7f6d980b7a20 msgr2=0x7f6d980b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:17.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 -- 172.21.15.94:0/3118075619 shutdown_connections 2024-03-18T18:09:17.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 -- 172.21.15.94:0/3118075619 wait complete. 2024-03-18T18:09:17.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 Processor -- start 2024-03-18T18:09:17.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:16.996+0000 7f6d9e99b700 1 -- start start 2024-03-18T18:09:17.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d980b13a0 0x7f6d981def20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:17.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d980acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:17.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9814cbf0 0x7f6d980affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:17.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981dfe90 con 0x7f6d9813e210 2024-03-18T18:09:17.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980af830 con 0x7f6d9814cbf0 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d98144070 con 0x7f6d980b13a0 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d980acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d980acac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35164/0 (socket says 172.21.15.94:35164) 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 -- 172.21.15.94:0/2982624667 learned_addr learned my addr 172.21.15.94:0/2982624667 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e19a700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9814cbf0 0x7f6d980affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d999700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d980b13a0 0x7f6d981def20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 -- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d980b13a0 msgr2=0x7f6d981def20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d980b13a0 0x7f6d981def20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 -- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9814cbf0 msgr2=0x7f6d980affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9814cbf0 0x7f6d980affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 -- 172.21.15.94:0/2982624667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d90009b30 con 0x7f6d9813e210 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d999700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d980b13a0 0x7f6d981def20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:17.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9d198700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d980acac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000b680 tx=0x7f6d90004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:17.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90004750 con 0x7f6d9813e210 2024-03-18T18:09:17.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d900092e0 con 0x7f6d9813e210 2024-03-18T18:09:17.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9001c440 con 0x7f6d9813e210 2024-03-18T18:09:17.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d980b75d0 con 0x7f6d9813e210 2024-03-18T18:09:17.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d980afaa0 con 0x7f6d9813e210 2024-03-18T18:09:17.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9806fd70 con 0x7f6d9813e210 2024-03-18T18:09:17.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6d9001c5a0 con 0x7f6d9813e210 2024-03-18T18:09:17.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.000+0000 7f6d8e7fc700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6d7c066730 0x7f6d7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:17.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.004+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d90085930 con 0x7f6d9813e210 2024-03-18T18:09:17.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.004+0000 7f6d9d999700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6d7c066730 0x7f6d7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:17.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.004+0000 7f6d9d999700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6d7c066730 0x7f6d7c068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d88000f60 tx=0x7f6d88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:17.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.008+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6d90052d30 con 0x7f6d9813e210 2024-03-18T18:09:17.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.176+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d9806f730 con 0x7f6d7c066730 2024-03-18T18:09:17.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.192+0000 7f6d8e7fc700 1 -- 172.21.15.94:0/2982624667 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f6d880014d0 con 0x7f6d7c066730 2024-03-18T18:09:17.198 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:17.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6d7c066730 msgr2=0x7f6d7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6d7c066730 0x7f6d7c068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d88000f60 tx=0x7f6d88009040 comp rx=0 tx=0).stop 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 msgr2=0x7f6d980acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d980acac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000b680 tx=0x7f6d90004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 shutdown_connections 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6d7c066730 0x7f6d7c068bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9814cbf0 0x7f6d980affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6d9813e210 0x7f6d980acac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 --2- 172.21.15.94:0/2982624667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d980b13a0 0x7f6d981def20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 >> 172.21.15.94:0/2982624667 conn(0x7f6d980b7a20 msgr2=0x7f6d980b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 shutdown_connections 2024-03-18T18:09:17.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:17.196+0000 7f6d9e99b700 1 -- 172.21.15.94:0/2982624667 wait complete. 2024-03-18T18:09:17.202 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:17.217 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-18T18:09:16.560194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235408,"kb_used_data":2848,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739312,"statfs":{"total":773094113280,"available":772853055488,"internally_reserved":0,"allocated":2916352,"data_stored":1754604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.142553"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225363+0000","last_change":"2024-03-18T18:09:12.850240+0000","last_active":"2024-03-18T18:09:15.225363+0000","last_peered":"2024-03-18T18:09:15.225363+0000","last_clean":"2024-03-18T18:09:15.225363+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:09:15.225363+0000","last_undegraded":"2024-03-18T18:09:15.225363+0000","last_fullsized":"2024-03-18T18:09:15.225363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823292+0000","last_change":"2024-03-18T18:09:12.829723+0000","last_active":"2024-03-18T18:09:13.823292+0000","last_peered":"2024-03-18T18:09:13.823292+0000","last_clean":"2024-03-18T18:09:13.823292+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:09:13.823292+0000","last_undegraded":"2024-03-18T18:09:13.823292+0000","last_fullsized":"2024-03-18T18:09:13.823292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835405+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:12.835405+0000","last_peered":"2024-03-18T18:09:12.835405+0000","last_clean":"2024-03-18T18:09:12.835405+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:12.835405+0000","last_undegraded":"2024-03-18T18:09:12.835405+0000","last_fullsized":"2024-03-18T18:09:12.835405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825838+0000","last_change":"2024-03-18T18:09:12.846004+0000","last_active":"2024-03-18T18:09:13.825838+0000","last_peered":"2024-03-18T18:09:13.825838+0000","last_clean":"2024-03-18T18:09:13.825838+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:09:13.825838+0000","last_undegraded":"2024-03-18T18:09:13.825838+0000","last_fullsized":"2024-03-18T18:09:13.825838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224681+0000","last_change":"2024-03-18T18:09:12.832618+0000","last_active":"2024-03-18T18:09:15.224681+0000","last_peered":"2024-03-18T18:09:15.224681+0000","last_clean":"2024-03-18T18:09:15.224681+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:09:15.224681+0000","last_undegraded":"2024-03-18T18:09:15.224681+0000","last_fullsized":"2024-03-18T18:09:15.224681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825354+0000","last_change":"2024-03-18T18:09:12.848392+0000","last_active":"2024-03-18T18:09:13.825354+0000","last_peered":"2024-03-18T18:09:13.825354+0000","last_clean":"2024-03-18T18:09:13.825354+0000","last_became_active":"2024-03-18T18:09:12.847328+0000","last_became_peered":"2024-03-18T18:09:12.847328+0000","last_unstale":"2024-03-18T18:09:13.825354+0000","last_undegraded":"2024-03-18T18:09:13.825354+0000","last_fullsized":"2024-03-18T18:09:13.825354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224245+0000","last_change":"2024-03-18T18:09:12.830837+0000","last_active":"2024-03-18T18:09:15.224245+0000","last_peered":"2024-03-18T18:09:15.224245+0000","last_clean":"2024-03-18T18:09:15.224245+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:09:15.224245+0000","last_undegraded":"2024-03-18T18:09:15.224245+0000","last_fullsized":"2024-03-18T18:09:15.224245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.845810+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:12.845810+0000","last_peered":"2024-03-18T18:09:12.845810+0000","last_clean":"2024-03-18T18:09:12.845810+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:12.845810+0000","last_undegraded":"2024-03-18T18:09:12.845810+0000","last_fullsized":"2024-03-18T18:09:12.845810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225374+0000","last_change":"2024-03-18T18:09:12.851456+0000","last_active":"2024-03-18T18:09:15.225374+0000","last_peered":"2024-03-18T18:09:15.225374+0000","last_clean":"2024-03-18T18:09:15.225374+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:09:15.225374+0000","last_undegraded":"2024-03-18T18:09:15.225374+0000","last_fullsized":"2024-03-18T18:09:15.225374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824563+0000","last_change":"2024-03-18T18:09:12.843717+0000","last_active":"2024-03-18T18:09:13.824563+0000","last_peered":"2024-03-18T18:09:13.824563+0000","last_clean":"2024-03-18T18:09:13.824563+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:09:13.824563+0000","last_undegraded":"2024-03-18T18:09:13.824563+0000","last_fullsized":"2024-03-18T18:09:13.824563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824325+0000","last_change":"2024-03-18T18:09:12.849907+0000","last_active":"2024-03-18T18:09:13.824325+0000","last_peered":"2024-03-18T18:09:13.824325+0000","last_clean":"2024-03-18T18:09:13.824325+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:09:13.824325+0000","last_undegraded":"2024-03-18T18:09:13.824325+0000","last_fullsized":"2024-03-18T18:09:13.824325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.852900+0000","last_change":"2024-03-18T18:09:12.849182+0000","last_active":"2024-03-18T18:09:12.852900+0000","last_peered":"2024-03-18T18:09:12.852900+0000","last_clean":"2024-03-18T18:09:12.852900+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:09:12.852900+0000","last_undegraded":"2024-03-18T18:09:12.852900+0000","last_fullsized":"2024-03-18T18:09:12.852900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.849694+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:12.849694+0000","last_peered":"2024-03-18T18:09:12.849694+0000","last_clean":"2024-03-18T18:09:12.849694+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:12.849694+0000","last_undegraded":"2024-03-18T18:09:12.849694+0000","last_fullsized":"2024-03-18T18:09:12.849694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837215+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:12.837215+0000","last_peered":"2024-03-18T18:09:12.837215+0000","last_clean":"2024-03-18T18:09:12.837215+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:12.837215+0000","last_undegraded":"2024-03-18T18:09:12.837215+0000","last_fullsized":"2024-03-18T18:09:12.837215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822920+0000","last_change":"2024-03-18T18:09:12.825991+0000","last_active":"2024-03-18T18:09:13.822920+0000","last_peered":"2024-03-18T18:09:13.822920+0000","last_clean":"2024-03-18T18:09:13.822920+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:09:13.822920+0000","last_undegraded":"2024-03-18T18:09:13.822920+0000","last_fullsized":"2024-03-18T18:09:13.822920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824411+0000","last_change":"2024-03-18T18:09:12.846860+0000","last_active":"2024-03-18T18:09:13.824411+0000","last_peered":"2024-03-18T18:09:13.824411+0000","last_clean":"2024-03-18T18:09:13.824411+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:09:13.824411+0000","last_undegraded":"2024-03-18T18:09:13.824411+0000","last_fullsized":"2024-03-18T18:09:13.824411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825299+0000","last_change":"2024-03-18T18:09:12.843072+0000","last_active":"2024-03-18T18:09:13.825299+0000","last_peered":"2024-03-18T18:09:13.825299+0000","last_clean":"2024-03-18T18:09:13.825299+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:09:13.825299+0000","last_undegraded":"2024-03-18T18:09:13.825299+0000","last_fullsized":"2024-03-18T18:09:13.825299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850261+0000","last_change":"2024-03-18T18:09:12.849294+0000","last_active":"2024-03-18T18:09:12.850261+0000","last_peered":"2024-03-18T18:09:12.850261+0000","last_clean":"2024-03-18T18:09:12.850261+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:09:12.850261+0000","last_undegraded":"2024-03-18T18:09:12.850261+0000","last_fullsized":"2024-03-18T18:09:12.850261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224970+0000","last_change":"2024-03-18T18:09:12.831998+0000","last_active":"2024-03-18T18:09:15.224970+0000","last_peered":"2024-03-18T18:09:15.224970+0000","last_clean":"2024-03-18T18:09:15.224970+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:09:15.224970+0000","last_undegraded":"2024-03-18T18:09:15.224970+0000","last_fullsized":"2024-03-18T18:09:15.224970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824295+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824295+0000","last_peered":"2024-03-18T18:09:13.824295+0000","last_clean":"2024-03-18T18:09:13.824295+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:09:13.824295+0000","last_undegraded":"2024-03-18T18:09:13.824295+0000","last_fullsized":"2024-03-18T18:09:13.824295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.838298+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:12.838298+0000","last_peered":"2024-03-18T18:09:12.838298+0000","last_clean":"2024-03-18T18:09:12.838298+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:12.838298+0000","last_undegraded":"2024-03-18T18:09:12.838298+0000","last_fullsized":"2024-03-18T18:09:12.838298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825593+0000","last_change":"2024-03-18T18:09:12.848244+0000","last_active":"2024-03-18T18:09:13.825593+0000","last_peered":"2024-03-18T18:09:13.825593+0000","last_clean":"2024-03-18T18:09:13.825593+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:09:13.825593+0000","last_undegraded":"2024-03-18T18:09:13.825593+0000","last_fullsized":"2024-03-18T18:09:13.825593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833494+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:12.833494+0000","last_peered":"2024-03-18T18:09:12.833494+0000","last_clean":"2024-03-18T18:09:12.833494+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:12.833494+0000","last_undegraded":"2024-03-18T18:09:12.833494+0000","last_fullsized":"2024-03-18T18:09:12.833494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824575+0000","last_change":"2024-03-18T18:09:12.839993+0000","last_active":"2024-03-18T18:09:13.824575+0000","last_peered":"2024-03-18T18:09:13.824575+0000","last_clean":"2024-03-18T18:09:13.824575+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:09:13.824575+0000","last_undegraded":"2024-03-18T18:09:13.824575+0000","last_fullsized":"2024-03-18T18:09:13.824575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833467+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:12.833467+0000","last_peered":"2024-03-18T18:09:12.833467+0000","last_clean":"2024-03-18T18:09:12.833467+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:12.833467+0000","last_undegraded":"2024-03-18T18:09:12.833467+0000","last_fullsized":"2024-03-18T18:09:12.833467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824588+0000","last_change":"2024-03-18T18:09:12.847998+0000","last_active":"2024-03-18T18:09:13.824588+0000","last_peered":"2024-03-18T18:09:13.824588+0000","last_clean":"2024-03-18T18:09:13.824588+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:09:13.824588+0000","last_undegraded":"2024-03-18T18:09:13.824588+0000","last_fullsized":"2024-03-18T18:09:13.824588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823431+0000","last_change":"2024-03-18T18:09:12.825151+0000","last_active":"2024-03-18T18:09:13.823431+0000","last_peered":"2024-03-18T18:09:13.823431+0000","last_clean":"2024-03-18T18:09:13.823431+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:09:13.823431+0000","last_undegraded":"2024-03-18T18:09:13.823431+0000","last_fullsized":"2024-03-18T18:09:13.823431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833441+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:12.833441+0000","last_peered":"2024-03-18T18:09:12.833441+0000","last_clean":"2024-03-18T18:09:12.833441+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:12.833441+0000","last_undegraded":"2024-03-18T18:09:12.833441+0000","last_fullsized":"2024-03-18T18:09:12.833441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837222+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:12.837222+0000","last_peered":"2024-03-18T18:09:12.837222+0000","last_clean":"2024-03-18T18:09:12.837222+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:12.837222+0000","last_undegraded":"2024-03-18T18:09:12.837222+0000","last_fullsized":"2024-03-18T18:09:12.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825499+0000","last_change":"2024-03-18T18:09:12.848253+0000","last_active":"2024-03-18T18:09:13.825499+0000","last_peered":"2024-03-18T18:09:13.825499+0000","last_clean":"2024-03-18T18:09:13.825499+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:09:13.825499+0000","last_undegraded":"2024-03-18T18:09:13.825499+0000","last_fullsized":"2024-03-18T18:09:13.825499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.844517+0000","last_change":"2024-03-18T18:09:12.843877+0000","last_active":"2024-03-18T18:09:12.844517+0000","last_peered":"2024-03-18T18:09:12.844517+0000","last_clean":"2024-03-18T18:09:12.844517+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:09:12.844517+0000","last_undegraded":"2024-03-18T18:09:12.844517+0000","last_fullsized":"2024-03-18T18:09:12.844517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824113+0000","last_change":"2024-03-18T18:09:12.847460+0000","last_active":"2024-03-18T18:09:13.824113+0000","last_peered":"2024-03-18T18:09:13.824113+0000","last_clean":"2024-03-18T18:09:13.824113+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:09:13.824113+0000","last_undegraded":"2024-03-18T18:09:13.824113+0000","last_fullsized":"2024-03-18T18:09:13.824113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839173+0000","last_change":"2024-03-18T18:09:12.828461+0000","last_active":"2024-03-18T18:09:12.839173+0000","last_peered":"2024-03-18T18:09:12.839173+0000","last_clean":"2024-03-18T18:09:12.839173+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:09:12.839173+0000","last_undegraded":"2024-03-18T18:09:12.839173+0000","last_fullsized":"2024-03-18T18:09:12.839173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837726+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:12.837726+0000","last_peered":"2024-03-18T18:09:12.837726+0000","last_clean":"2024-03-18T18:09:12.837726+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:12.837726+0000","last_undegraded":"2024-03-18T18:09:12.837726+0000","last_fullsized":"2024-03-18T18:09:12.837726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840122+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:12.840122+0000","last_peered":"2024-03-18T18:09:12.840122+0000","last_clean":"2024-03-18T18:09:12.840122+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:12.840122+0000","last_undegraded":"2024-03-18T18:09:12.840122+0000","last_fullsized":"2024-03-18T18:09:12.840122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824203+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:09:13.824203+0000","last_peered":"2024-03-18T18:09:13.824203+0000","last_clean":"2024-03-18T18:09:13.824203+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:09:13.824203+0000","last_undegraded":"2024-03-18T18:09:13.824203+0000","last_fullsized":"2024-03-18T18:09:13.824203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820402+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:12.820402+0000","last_peered":"2024-03-18T18:09:12.820402+0000","last_clean":"2024-03-18T18:09:12.820402+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:12.820402+0000","last_undegraded":"2024-03-18T18:09:12.820402+0000","last_fullsized":"2024-03-18T18:09:12.820402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835017+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:12.835017+0000","last_peered":"2024-03-18T18:09:12.835017+0000","last_clean":"2024-03-18T18:09:12.835017+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:12.835017+0000","last_undegraded":"2024-03-18T18:09:12.835017+0000","last_fullsized":"2024-03-18T18:09:12.835017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824553+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:09:13.824553+0000","last_peered":"2024-03-18T18:09:13.824553+0000","last_clean":"2024-03-18T18:09:13.824553+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:09:13.824553+0000","last_undegraded":"2024-03-18T18:09:13.824553+0000","last_fullsized":"2024-03-18T18:09:13.824553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822841+0000","last_change":"2024-03-18T18:09:12.824723+0000","last_active":"2024-03-18T18:09:13.822841+0000","last_peered":"2024-03-18T18:09:13.822841+0000","last_clean":"2024-03-18T18:09:13.822841+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:09:13.822841+0000","last_undegraded":"2024-03-18T18:09:13.822841+0000","last_fullsized":"2024-03-18T18:09:13.822841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824781+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:09:13.824781+0000","last_peered":"2024-03-18T18:09:13.824781+0000","last_clean":"2024-03-18T18:09:13.824781+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:09:13.824781+0000","last_undegraded":"2024-03-18T18:09:13.824781+0000","last_fullsized":"2024-03-18T18:09:13.824781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824739+0000","last_change":"2024-03-18T18:09:12.843128+0000","last_active":"2024-03-18T18:09:13.824739+0000","last_peered":"2024-03-18T18:09:13.824739+0000","last_clean":"2024-03-18T18:09:13.824739+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:09:13.824739+0000","last_undegraded":"2024-03-18T18:09:13.824739+0000","last_fullsized":"2024-03-18T18:09:13.824739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824800+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:09:13.824800+0000","last_peered":"2024-03-18T18:09:13.824800+0000","last_clean":"2024-03-18T18:09:13.824800+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:09:13.824800+0000","last_undegraded":"2024-03-18T18:09:13.824800+0000","last_fullsized":"2024-03-18T18:09:13.824800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851726+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:12.851726+0000","last_peered":"2024-03-18T18:09:12.851726+0000","last_clean":"2024-03-18T18:09:12.851726+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:12.851726+0000","last_undegraded":"2024-03-18T18:09:12.851726+0000","last_fullsized":"2024-03-18T18:09:12.851726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823072+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:09:13.823072+0000","last_peered":"2024-03-18T18:09:13.823072+0000","last_clean":"2024-03-18T18:09:13.823072+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:09:13.823072+0000","last_undegraded":"2024-03-18T18:09:13.823072+0000","last_fullsized":"2024-03-18T18:09:13.823072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840231+0000","last_change":"2024-03-18T18:09:12.837565+0000","last_active":"2024-03-18T18:09:12.840231+0000","last_peered":"2024-03-18T18:09:12.840231+0000","last_clean":"2024-03-18T18:09:12.840231+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:09:12.840231+0000","last_undegraded":"2024-03-18T18:09:12.840231+0000","last_fullsized":"2024-03-18T18:09:12.840231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824406+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:09:13.824406+0000","last_peered":"2024-03-18T18:09:13.824406+0000","last_clean":"2024-03-18T18:09:13.824406+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:09:13.824406+0000","last_undegraded":"2024-03-18T18:09:13.824406+0000","last_fullsized":"2024-03-18T18:09:13.824406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224581+0000","last_change":"2024-03-18T18:09:12.830990+0000","last_active":"2024-03-18T18:09:15.224581+0000","last_peered":"2024-03-18T18:09:15.224581+0000","last_clean":"2024-03-18T18:09:15.224581+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:09:15.224581+0000","last_undegraded":"2024-03-18T18:09:15.224581+0000","last_fullsized":"2024-03-18T18:09:15.224581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.843026+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:12.843026+0000","last_peered":"2024-03-18T18:09:12.843026+0000","last_clean":"2024-03-18T18:09:12.843026+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:12.843026+0000","last_undegraded":"2024-03-18T18:09:12.843026+0000","last_fullsized":"2024-03-18T18:09:12.843026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835417+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:12.835417+0000","last_peered":"2024-03-18T18:09:12.835417+0000","last_clean":"2024-03-18T18:09:12.835417+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:12.835417+0000","last_undegraded":"2024-03-18T18:09:12.835417+0000","last_fullsized":"2024-03-18T18:09:12.835417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825559+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:09:13.825559+0000","last_peered":"2024-03-18T18:09:13.825559+0000","last_clean":"2024-03-18T18:09:13.825559+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:09:13.825559+0000","last_undegraded":"2024-03-18T18:09:13.825559+0000","last_fullsized":"2024-03-18T18:09:13.825559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224731+0000","last_change":"2024-03-18T18:09:12.839323+0000","last_active":"2024-03-18T18:09:15.224731+0000","last_peered":"2024-03-18T18:09:15.224731+0000","last_clean":"2024-03-18T18:09:15.224731+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:09:15.224731+0000","last_undegraded":"2024-03-18T18:09:15.224731+0000","last_fullsized":"2024-03-18T18:09:15.224731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824196+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:09:13.824196+0000","last_peered":"2024-03-18T18:09:13.824196+0000","last_clean":"2024-03-18T18:09:13.824196+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:09:13.824196+0000","last_undegraded":"2024-03-18T18:09:13.824196+0000","last_fullsized":"2024-03-18T18:09:13.824196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825747+0000","last_change":"2024-03-18T18:09:12.847297+0000","last_active":"2024-03-18T18:09:13.825747+0000","last_peered":"2024-03-18T18:09:13.825747+0000","last_clean":"2024-03-18T18:09:13.825747+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:09:13.825747+0000","last_undegraded":"2024-03-18T18:09:13.825747+0000","last_fullsized":"2024-03-18T18:09:13.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837921+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:09:12.837921+0000","last_peered":"2024-03-18T18:09:12.837921+0000","last_clean":"2024-03-18T18:09:12.837921+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:09:12.837921+0000","last_undegraded":"2024-03-18T18:09:12.837921+0000","last_fullsized":"2024-03-18T18:09:12.837921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224387+0000","last_change":"2024-03-18T18:09:12.838637+0000","last_active":"2024-03-18T18:09:15.224387+0000","last_peered":"2024-03-18T18:09:15.224387+0000","last_clean":"2024-03-18T18:09:15.224387+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:09:15.224387+0000","last_undegraded":"2024-03-18T18:09:15.224387+0000","last_fullsized":"2024-03-18T18:09:15.224387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835800+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:09:12.835800+0000","last_peered":"2024-03-18T18:09:12.835800+0000","last_clean":"2024-03-18T18:09:12.835800+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:09:12.835800+0000","last_undegraded":"2024-03-18T18:09:12.835800+0000","last_fullsized":"2024-03-18T18:09:12.835800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225074+0000","last_change":"2024-03-18T18:09:12.838775+0000","last_active":"2024-03-18T18:09:15.225074+0000","last_peered":"2024-03-18T18:09:15.225074+0000","last_clean":"2024-03-18T18:09:15.225074+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:09:15.225074+0000","last_undegraded":"2024-03-18T18:09:15.225074+0000","last_fullsized":"2024-03-18T18:09:15.225074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835337+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:09:12.835337+0000","last_peered":"2024-03-18T18:09:12.835337+0000","last_clean":"2024-03-18T18:09:12.835337+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:09:12.835337+0000","last_undegraded":"2024-03-18T18:09:12.835337+0000","last_fullsized":"2024-03-18T18:09:12.835337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225593+0000","last_change":"2024-03-18T18:09:12.841196+0000","last_active":"2024-03-18T18:09:15.225593+0000","last_peered":"2024-03-18T18:09:15.225593+0000","last_clean":"2024-03-18T18:09:15.225593+0000","last_became_active":"2024-03-18T18:09:12.840659+0000","last_became_peered":"2024-03-18T18:09:12.840659+0000","last_unstale":"2024-03-18T18:09:15.225593+0000","last_undegraded":"2024-03-18T18:09:15.225593+0000","last_fullsized":"2024-03-18T18:09:15.225593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823141+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:09:13.823141+0000","last_peered":"2024-03-18T18:09:13.823141+0000","last_clean":"2024-03-18T18:09:13.823141+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:09:13.823141+0000","last_undegraded":"2024-03-18T18:09:13.823141+0000","last_fullsized":"2024-03-18T18:09:13.823141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825348+0000","last_change":"2024-03-18T18:09:12.834479+0000","last_active":"2024-03-18T18:09:13.825348+0000","last_peered":"2024-03-18T18:09:13.825348+0000","last_clean":"2024-03-18T18:09:13.825348+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:09:13.825348+0000","last_undegraded":"2024-03-18T18:09:13.825348+0000","last_fullsized":"2024-03-18T18:09:13.825348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820127+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:09:12.820127+0000","last_peered":"2024-03-18T18:09:12.820127+0000","last_clean":"2024-03-18T18:09:12.820127+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:09:12.820127+0000","last_undegraded":"2024-03-18T18:09:12.820127+0000","last_fullsized":"2024-03-18T18:09:12.820127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224685+0000","last_change":"2024-03-18T18:09:12.845096+0000","last_active":"2024-03-18T18:09:15.224685+0000","last_peered":"2024-03-18T18:09:15.224685+0000","last_clean":"2024-03-18T18:09:15.224685+0000","last_became_active":"2024-03-18T18:09:12.844794+0000","last_became_peered":"2024-03-18T18:09:12.844794+0000","last_unstale":"2024-03-18T18:09:15.224685+0000","last_undegraded":"2024-03-18T18:09:15.224685+0000","last_fullsized":"2024-03-18T18:09:15.224685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:47.908637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.822307+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:12.822307+0000","last_peered":"2024-03-18T18:09:12.822307+0000","last_clean":"2024-03-18T18:09:12.822307+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:12.822307+0000","last_undegraded":"2024-03-18T18:09:12.822307+0000","last_fullsized":"2024-03-18T18:09:12.822307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824253+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:09:13.824253+0000","last_peered":"2024-03-18T18:09:13.824253+0000","last_clean":"2024-03-18T18:09:13.824253+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:09:13.824253+0000","last_undegraded":"2024-03-18T18:09:13.824253+0000","last_fullsized":"2024-03-18T18:09:13.824253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851080+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:12.851080+0000","last_peered":"2024-03-18T18:09:12.851080+0000","last_clean":"2024-03-18T18:09:12.851080+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:12.851080+0000","last_undegraded":"2024-03-18T18:09:12.851080+0000","last_fullsized":"2024-03-18T18:09:12.851080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224061+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:09:15.224061+0000","last_peered":"2024-03-18T18:09:15.224061+0000","last_clean":"2024-03-18T18:09:15.224061+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:09:15.224061+0000","last_undegraded":"2024-03-18T18:09:15.224061+0000","last_fullsized":"2024-03-18T18:09:15.224061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839841+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:12.839841+0000","last_peered":"2024-03-18T18:09:12.839841+0000","last_clean":"2024-03-18T18:09:12.839841+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:12.839841+0000","last_undegraded":"2024-03-18T18:09:12.839841+0000","last_fullsized":"2024-03-18T18:09:12.839841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820008+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:09:12.820008+0000","last_peered":"2024-03-18T18:09:12.820008+0000","last_clean":"2024-03-18T18:09:12.820008+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:09:12.820008+0000","last_undegraded":"2024-03-18T18:09:12.820008+0000","last_fullsized":"2024-03-18T18:09:12.820008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822734+0000","last_change":"2024-03-18T18:09:12.822692+0000","last_active":"2024-03-18T18:09:13.822734+0000","last_peered":"2024-03-18T18:09:13.822734+0000","last_clean":"2024-03-18T18:09:13.822734+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:09:13.822734+0000","last_undegraded":"2024-03-18T18:09:13.822734+0000","last_fullsized":"2024-03-18T18:09:13.822734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825607+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:09:13.825607+0000","last_peered":"2024-03-18T18:09:13.825607+0000","last_clean":"2024-03-18T18:09:13.825607+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:09:13.825607+0000","last_undegraded":"2024-03-18T18:09:13.825607+0000","last_fullsized":"2024-03-18T18:09:13.825607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839446+0000","last_change":"2024-03-18T18:09:12.835734+0000","last_active":"2024-03-18T18:09:12.839446+0000","last_peered":"2024-03-18T18:09:12.839446+0000","last_clean":"2024-03-18T18:09:12.839446+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:09:12.839446+0000","last_undegraded":"2024-03-18T18:09:12.839446+0000","last_fullsized":"2024-03-18T18:09:12.839446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822995+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:09:13.822995+0000","last_peered":"2024-03-18T18:09:13.822995+0000","last_clean":"2024-03-18T18:09:13.822995+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:09:13.822995+0000","last_undegraded":"2024-03-18T18:09:13.822995+0000","last_fullsized":"2024-03-18T18:09:13.822995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824964+0000","last_change":"2024-03-18T18:09:12.842890+0000","last_active":"2024-03-18T18:09:13.824964+0000","last_peered":"2024-03-18T18:09:13.824964+0000","last_clean":"2024-03-18T18:09:13.824964+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:09:13.824964+0000","last_undegraded":"2024-03-18T18:09:13.824964+0000","last_fullsized":"2024-03-18T18:09:13.824964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225099+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:09:15.225099+0000","last_peered":"2024-03-18T18:09:15.225099+0000","last_clean":"2024-03-18T18:09:15.225099+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:09:15.225099+0000","last_undegraded":"2024-03-18T18:09:15.225099+0000","last_fullsized":"2024-03-18T18:09:15.225099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822874+0000","last_change":"2024-03-18T18:09:12.821957+0000","last_active":"2024-03-18T18:09:13.822874+0000","last_peered":"2024-03-18T18:09:13.822874+0000","last_clean":"2024-03-18T18:09:13.822874+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:09:13.822874+0000","last_undegraded":"2024-03-18T18:09:13.822874+0000","last_fullsized":"2024-03-18T18:09:13.822874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823352+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:09:13.823352+0000","last_peered":"2024-03-18T18:09:13.823352+0000","last_clean":"2024-03-18T18:09:13.823352+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:09:13.823352+0000","last_undegraded":"2024-03-18T18:09:13.823352+0000","last_fullsized":"2024-03-18T18:09:13.823352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834965+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:12.834965+0000","last_peered":"2024-03-18T18:09:12.834965+0000","last_clean":"2024-03-18T18:09:12.834965+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:12.834965+0000","last_undegraded":"2024-03-18T18:09:12.834965+0000","last_fullsized":"2024-03-18T18:09:12.834965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824875+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:09:13.824875+0000","last_peered":"2024-03-18T18:09:13.824875+0000","last_clean":"2024-03-18T18:09:13.824875+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:09:13.824875+0000","last_undegraded":"2024-03-18T18:09:13.824875+0000","last_fullsized":"2024-03-18T18:09:13.824875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.832536+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:12.832536+0000","last_peered":"2024-03-18T18:09:12.832536+0000","last_clean":"2024-03-18T18:09:12.832536+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:12.832536+0000","last_undegraded":"2024-03-18T18:09:12.832536+0000","last_fullsized":"2024-03-18T18:09:12.832536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224023+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:09:15.224023+0000","last_peered":"2024-03-18T18:09:15.224023+0000","last_clean":"2024-03-18T18:09:15.224023+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:09:15.224023+0000","last_undegraded":"2024-03-18T18:09:15.224023+0000","last_fullsized":"2024-03-18T18:09:15.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837325+0000","last_change":"2024-03-18T18:09:12.824858+0000","last_active":"2024-03-18T18:09:12.837325+0000","last_peered":"2024-03-18T18:09:12.837325+0000","last_clean":"2024-03-18T18:09:12.837325+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:09:12.837325+0000","last_undegraded":"2024-03-18T18:09:12.837325+0000","last_fullsized":"2024-03-18T18:09:12.837325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823079+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:09:13.823079+0000","last_peered":"2024-03-18T18:09:13.823079+0000","last_clean":"2024-03-18T18:09:13.823079+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:09:13.823079+0000","last_undegraded":"2024-03-18T18:09:13.823079+0000","last_fullsized":"2024-03-18T18:09:13.823079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833573+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:12.833573+0000","last_peered":"2024-03-18T18:09:12.833573+0000","last_clean":"2024-03-18T18:09:12.833573+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:12.833573+0000","last_undegraded":"2024-03-18T18:09:12.833573+0000","last_fullsized":"2024-03-18T18:09:12.833573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823186+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:09:13.823186+0000","last_peered":"2024-03-18T18:09:13.823186+0000","last_clean":"2024-03-18T18:09:13.823186+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:09:13.823186+0000","last_undegraded":"2024-03-18T18:09:13.823186+0000","last_fullsized":"2024-03-18T18:09:13.823186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834995+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:12.834995+0000","last_peered":"2024-03-18T18:09:12.834995+0000","last_clean":"2024-03-18T18:09:12.834995+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:12.834995+0000","last_undegraded":"2024-03-18T18:09:12.834995+0000","last_fullsized":"2024-03-18T18:09:12.834995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224945+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:09:15.224945+0000","last_peered":"2024-03-18T18:09:15.224945+0000","last_clean":"2024-03-18T18:09:15.224945+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:09:15.224945+0000","last_undegraded":"2024-03-18T18:09:15.224945+0000","last_fullsized":"2024-03-18T18:09:15.224945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824060+0000","last_change":"2024-03-18T18:09:12.842987+0000","last_active":"2024-03-18T18:09:13.824060+0000","last_peered":"2024-03-18T18:09:13.824060+0000","last_clean":"2024-03-18T18:09:13.824060+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:09:13.824060+0000","last_undegraded":"2024-03-18T18:09:13.824060+0000","last_fullsized":"2024-03-18T18:09:13.824060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824811+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824811+0000","last_peered":"2024-03-18T18:09:13.824811+0000","last_clean":"2024-03-18T18:09:13.824811+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:09:13.824811+0000","last_undegraded":"2024-03-18T18:09:13.824811+0000","last_fullsized":"2024-03-18T18:09:13.824811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224645+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:09:15.224645+0000","last_peered":"2024-03-18T18:09:15.224645+0000","last_clean":"2024-03-18T18:09:15.224645+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:09:15.224645+0000","last_undegraded":"2024-03-18T18:09:15.224645+0000","last_fullsized":"2024-03-18T18:09:15.224645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825111+0000","last_change":"2024-03-18T18:09:12.849269+0000","last_active":"2024-03-18T18:09:13.825111+0000","last_peered":"2024-03-18T18:09:13.825111+0000","last_clean":"2024-03-18T18:09:13.825111+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:09:13.825111+0000","last_undegraded":"2024-03-18T18:09:13.825111+0000","last_fullsized":"2024-03-18T18:09:13.825111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224838+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:09:15.224838+0000","last_peered":"2024-03-18T18:09:15.224838+0000","last_clean":"2024-03-18T18:09:15.224838+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:09:15.224838+0000","last_undegraded":"2024-03-18T18:09:15.224838+0000","last_fullsized":"2024-03-18T18:09:15.224838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851751+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:12.851751+0000","last_peered":"2024-03-18T18:09:12.851751+0000","last_clean":"2024-03-18T18:09:12.851751+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:12.851751+0000","last_undegraded":"2024-03-18T18:09:12.851751+0000","last_fullsized":"2024-03-18T18:09:12.851751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837411+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:12.837411+0000","last_peered":"2024-03-18T18:09:12.837411+0000","last_clean":"2024-03-18T18:09:12.837411+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:12.837411+0000","last_undegraded":"2024-03-18T18:09:12.837411+0000","last_fullsized":"2024-03-18T18:09:12.837411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850617+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:12.850617+0000","last_peered":"2024-03-18T18:09:12.850617+0000","last_clean":"2024-03-18T18:09:12.850617+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:12.850617+0000","last_undegraded":"2024-03-18T18:09:12.850617+0000","last_fullsized":"2024-03-18T18:09:12.850617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837648+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:12.837648+0000","last_peered":"2024-03-18T18:09:12.837648+0000","last_clean":"2024-03-18T18:09:12.837648+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:12.837648+0000","last_undegraded":"2024-03-18T18:09:12.837648+0000","last_fullsized":"2024-03-18T18:09:12.837648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":660518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":69568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":69728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":71132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":660574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:20.222 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:20.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 Processor -- start 2024-03-18T18:09:20.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- start start 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ca406ea40 0x7f6ca40b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6ca4148750 0x7f6ca414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca4147e60 con 0x7f6ca41482f0 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40aedd0 con 0x7f6ca406ea40 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca406ee20 con 0x7f6ca4148750 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ca406ea40 0x7f6ca40b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ca406ea40 0x7f6ca40b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35180/0 (socket says 172.21.15.94:35180) 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 -- 172.21.15.94:0/2122096952 learned_addr learned my addr 172.21.15.94:0/2122096952 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca8c43700 1 --2- 172.21.15.94:0/2122096952 >> v2:172.21.15.151:3300/0 conn(0x7f6ca4148750 0x7f6ca414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 -- 172.21.15.94:0/2122096952 >> v2:172.21.15.151:3300/0 conn(0x7f6ca4148750 msgr2=0x7f6ca414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 --2- 172.21.15.94:0/2122096952 >> v2:172.21.15.151:3300/0 conn(0x7f6ca4148750 0x7f6ca414ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 -- 172.21.15.94:0/2122096952 >> v1:172.21.15.94:6789/0 conn(0x7f6ca41482f0 legacy=0x7f6ca40718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 -- 172.21.15.94:0/2122096952 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40b1850 con 0x7f6ca406ea40 2024-03-18T18:09:20.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca3fff700 1 --2- 172.21.15.94:0/2122096952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca406ea40 0x7f6ca40b1310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ca406f510 tx=0x7f6c94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757190a18fd833e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:20.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca2ffd700 1 -- 172.21.15.94:0/2122096952 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400b8a0 con 0x7f6ca406ea40 2024-03-18T18:09:20.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca2ffd700 1 -- 172.21.15.94:0/2122096952 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9400ba00 con 0x7f6ca406ea40 2024-03-18T18:09:20.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6ca2ffd700 1 -- 172.21.15.94:0/2122096952 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400bd90 con 0x7f6ca406ea40 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2122096952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca406ea40 msgr2=0x7f6ca40b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2122096952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca406ea40 0x7f6ca40b1310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ca406f510 tx=0x7f6c94009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2122096952 shutdown_connections 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2122096952 >> v2:172.21.15.151:3300/0 conn(0x7f6ca4148750 0x7f6ca414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2122096952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca406ea40 0x7f6ca40b1310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2122096952 >> 172.21.15.94:0/2122096952 conn(0x7f6ca40b7c00 msgr2=0x7f6ca40b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2122096952 shutdown_connections 2024-03-18T18:09:20.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.344+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2122096952 wait complete. 2024-03-18T18:09:20.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 Processor -- start 2024-03-18T18:09:20.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 -- start start 2024-03-18T18:09:20.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ca406ea40 0x7f6ca41dd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 0x7f6ca413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ca4148750 0x7f6ca413f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4141cf0 con 0x7f6ca41482f0 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40a85c0 con 0x7f6ca4148750 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6caa6a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4140940 con 0x7f6ca406ea40 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6ca37fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 0x7f6ca413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6ca37fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 0x7f6ca413f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35194/0 (socket says 172.21.15.94:35194) 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6ca37fe700 1 -- 172.21.15.94:0/2489534862 learned_addr learned my addr 172.21.15.94:0/2489534862 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6ca3fff700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ca406ea40 0x7f6ca41dd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.348+0000 7f6ca8c43700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ca4148750 0x7f6ca413f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca37fe700 1 -- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ca406ea40 msgr2=0x7f6ca41dd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca37fe700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ca406ea40 0x7f6ca41dd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca37fe700 1 -- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ca4148750 msgr2=0x7f6ca413f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca37fe700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ca4148750 0x7f6ca413f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca37fe700 1 -- 172.21.15.94:0/2489534862 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009570 con 0x7f6ca41482f0 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca37fe700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 0x7f6ca413f3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c500 tx=0x7f6c9800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980052d0 con 0x7f6ca41482f0 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98005430 con 0x7f6ca41482f0 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca40b2780 con 0x7f6ca41482f0 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980055a0 con 0x7f6ca41482f0 2024-03-18T18:09:20.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca41ddad0 con 0x7f6ca41482f0 2024-03-18T18:09:20.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca4068310 con 0x7f6ca41482f0 2024-03-18T18:09:20.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.352+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6c980038e0 con 0x7f6ca41482f0 2024-03-18T18:09:20.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.356+0000 7f6ca0ff9700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6c90066730 0x7f6c90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.356+0000 7f6ca3fff700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6c90066730 0x7f6c90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.356+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c98083490 con 0x7f6ca41482f0 2024-03-18T18:09:20.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.356+0000 7f6ca3fff700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6c90066730 0x7f6c90068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000c00 tx=0x7f6c94008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:20.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.360+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6c98050890 con 0x7f6ca41482f0 2024-03-18T18:09:20.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.528+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ca40b2600 con 0x7f6c90066730 2024-03-18T18:09:20.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.540+0000 7f6ca0ff9700 1 -- 172.21.15.94:0/2489534862 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7f6c940040f0 con 0x7f6c90066730 2024-03-18T18:09:20.550 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:20.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6c90066730 msgr2=0x7f6c90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6c90066730 0x7f6c90068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000c00 tx=0x7f6c94008030 comp rx=0 tx=0).stop 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 msgr2=0x7f6ca413f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 0x7f6ca413f3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c500 tx=0x7f6c9800c810 comp rx=0 tx=0).stop 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 shutdown_connections 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6c90066730 0x7f6c90068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ca4148750 0x7f6ca413f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ca41482f0 0x7f6ca413f3b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 --2- 172.21.15.94:0/2489534862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ca406ea40 0x7f6ca41dd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 >> 172.21.15.94:0/2489534862 conn(0x7f6ca40b7c00 msgr2=0x7f6ca41473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 shutdown_connections 2024-03-18T18:09:20.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.548+0000 7f6caa6a6700 1 -- 172.21.15.94:0/2489534862 wait complete. 2024-03-18T18:09:20.554 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:20.566 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-18T18:09:18.561055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235408,"kb_used_data":2848,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739312,"statfs":{"total":773094113280,"available":772853055488,"internally_reserved":0,"allocated":2916352,"data_stored":1754604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.138869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225363+0000","last_change":"2024-03-18T18:09:12.850240+0000","last_active":"2024-03-18T18:09:15.225363+0000","last_peered":"2024-03-18T18:09:15.225363+0000","last_clean":"2024-03-18T18:09:15.225363+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:09:15.225363+0000","last_undegraded":"2024-03-18T18:09:15.225363+0000","last_fullsized":"2024-03-18T18:09:15.225363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823292+0000","last_change":"2024-03-18T18:09:12.829723+0000","last_active":"2024-03-18T18:09:13.823292+0000","last_peered":"2024-03-18T18:09:13.823292+0000","last_clean":"2024-03-18T18:09:13.823292+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:09:13.823292+0000","last_undegraded":"2024-03-18T18:09:13.823292+0000","last_fullsized":"2024-03-18T18:09:13.823292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835405+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:12.835405+0000","last_peered":"2024-03-18T18:09:12.835405+0000","last_clean":"2024-03-18T18:09:12.835405+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:12.835405+0000","last_undegraded":"2024-03-18T18:09:12.835405+0000","last_fullsized":"2024-03-18T18:09:12.835405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825838+0000","last_change":"2024-03-18T18:09:12.846004+0000","last_active":"2024-03-18T18:09:13.825838+0000","last_peered":"2024-03-18T18:09:13.825838+0000","last_clean":"2024-03-18T18:09:13.825838+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:09:13.825838+0000","last_undegraded":"2024-03-18T18:09:13.825838+0000","last_fullsized":"2024-03-18T18:09:13.825838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224681+0000","last_change":"2024-03-18T18:09:12.832618+0000","last_active":"2024-03-18T18:09:15.224681+0000","last_peered":"2024-03-18T18:09:15.224681+0000","last_clean":"2024-03-18T18:09:15.224681+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:09:15.224681+0000","last_undegraded":"2024-03-18T18:09:15.224681+0000","last_fullsized":"2024-03-18T18:09:15.224681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825354+0000","last_change":"2024-03-18T18:09:12.848392+0000","last_active":"2024-03-18T18:09:13.825354+0000","last_peered":"2024-03-18T18:09:13.825354+0000","last_clean":"2024-03-18T18:09:13.825354+0000","last_became_active":"2024-03-18T18:09:12.847328+0000","last_became_peered":"2024-03-18T18:09:12.847328+0000","last_unstale":"2024-03-18T18:09:13.825354+0000","last_undegraded":"2024-03-18T18:09:13.825354+0000","last_fullsized":"2024-03-18T18:09:13.825354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224245+0000","last_change":"2024-03-18T18:09:12.830837+0000","last_active":"2024-03-18T18:09:15.224245+0000","last_peered":"2024-03-18T18:09:15.224245+0000","last_clean":"2024-03-18T18:09:15.224245+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:09:15.224245+0000","last_undegraded":"2024-03-18T18:09:15.224245+0000","last_fullsized":"2024-03-18T18:09:15.224245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.845810+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:12.845810+0000","last_peered":"2024-03-18T18:09:12.845810+0000","last_clean":"2024-03-18T18:09:12.845810+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:12.845810+0000","last_undegraded":"2024-03-18T18:09:12.845810+0000","last_fullsized":"2024-03-18T18:09:12.845810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225374+0000","last_change":"2024-03-18T18:09:12.851456+0000","last_active":"2024-03-18T18:09:15.225374+0000","last_peered":"2024-03-18T18:09:15.225374+0000","last_clean":"2024-03-18T18:09:15.225374+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:09:15.225374+0000","last_undegraded":"2024-03-18T18:09:15.225374+0000","last_fullsized":"2024-03-18T18:09:15.225374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824563+0000","last_change":"2024-03-18T18:09:12.843717+0000","last_active":"2024-03-18T18:09:13.824563+0000","last_peered":"2024-03-18T18:09:13.824563+0000","last_clean":"2024-03-18T18:09:13.824563+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:09:13.824563+0000","last_undegraded":"2024-03-18T18:09:13.824563+0000","last_fullsized":"2024-03-18T18:09:13.824563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824325+0000","last_change":"2024-03-18T18:09:12.849907+0000","last_active":"2024-03-18T18:09:13.824325+0000","last_peered":"2024-03-18T18:09:13.824325+0000","last_clean":"2024-03-18T18:09:13.824325+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:09:13.824325+0000","last_undegraded":"2024-03-18T18:09:13.824325+0000","last_fullsized":"2024-03-18T18:09:13.824325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.852900+0000","last_change":"2024-03-18T18:09:12.849182+0000","last_active":"2024-03-18T18:09:12.852900+0000","last_peered":"2024-03-18T18:09:12.852900+0000","last_clean":"2024-03-18T18:09:12.852900+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:09:12.852900+0000","last_undegraded":"2024-03-18T18:09:12.852900+0000","last_fullsized":"2024-03-18T18:09:12.852900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.849694+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:12.849694+0000","last_peered":"2024-03-18T18:09:12.849694+0000","last_clean":"2024-03-18T18:09:12.849694+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:12.849694+0000","last_undegraded":"2024-03-18T18:09:12.849694+0000","last_fullsized":"2024-03-18T18:09:12.849694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837215+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:12.837215+0000","last_peered":"2024-03-18T18:09:12.837215+0000","last_clean":"2024-03-18T18:09:12.837215+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:12.837215+0000","last_undegraded":"2024-03-18T18:09:12.837215+0000","last_fullsized":"2024-03-18T18:09:12.837215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822920+0000","last_change":"2024-03-18T18:09:12.825991+0000","last_active":"2024-03-18T18:09:13.822920+0000","last_peered":"2024-03-18T18:09:13.822920+0000","last_clean":"2024-03-18T18:09:13.822920+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:09:13.822920+0000","last_undegraded":"2024-03-18T18:09:13.822920+0000","last_fullsized":"2024-03-18T18:09:13.822920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824411+0000","last_change":"2024-03-18T18:09:12.846860+0000","last_active":"2024-03-18T18:09:13.824411+0000","last_peered":"2024-03-18T18:09:13.824411+0000","last_clean":"2024-03-18T18:09:13.824411+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:09:13.824411+0000","last_undegraded":"2024-03-18T18:09:13.824411+0000","last_fullsized":"2024-03-18T18:09:13.824411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825299+0000","last_change":"2024-03-18T18:09:12.843072+0000","last_active":"2024-03-18T18:09:13.825299+0000","last_peered":"2024-03-18T18:09:13.825299+0000","last_clean":"2024-03-18T18:09:13.825299+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:09:13.825299+0000","last_undegraded":"2024-03-18T18:09:13.825299+0000","last_fullsized":"2024-03-18T18:09:13.825299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850261+0000","last_change":"2024-03-18T18:09:12.849294+0000","last_active":"2024-03-18T18:09:12.850261+0000","last_peered":"2024-03-18T18:09:12.850261+0000","last_clean":"2024-03-18T18:09:12.850261+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:09:12.850261+0000","last_undegraded":"2024-03-18T18:09:12.850261+0000","last_fullsized":"2024-03-18T18:09:12.850261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224970+0000","last_change":"2024-03-18T18:09:12.831998+0000","last_active":"2024-03-18T18:09:15.224970+0000","last_peered":"2024-03-18T18:09:15.224970+0000","last_clean":"2024-03-18T18:09:15.224970+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:09:15.224970+0000","last_undegraded":"2024-03-18T18:09:15.224970+0000","last_fullsized":"2024-03-18T18:09:15.224970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824295+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824295+0000","last_peered":"2024-03-18T18:09:13.824295+0000","last_clean":"2024-03-18T18:09:13.824295+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:09:13.824295+0000","last_undegraded":"2024-03-18T18:09:13.824295+0000","last_fullsized":"2024-03-18T18:09:13.824295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.838298+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:12.838298+0000","last_peered":"2024-03-18T18:09:12.838298+0000","last_clean":"2024-03-18T18:09:12.838298+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:12.838298+0000","last_undegraded":"2024-03-18T18:09:12.838298+0000","last_fullsized":"2024-03-18T18:09:12.838298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825593+0000","last_change":"2024-03-18T18:09:12.848244+0000","last_active":"2024-03-18T18:09:13.825593+0000","last_peered":"2024-03-18T18:09:13.825593+0000","last_clean":"2024-03-18T18:09:13.825593+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:09:13.825593+0000","last_undegraded":"2024-03-18T18:09:13.825593+0000","last_fullsized":"2024-03-18T18:09:13.825593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833494+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:12.833494+0000","last_peered":"2024-03-18T18:09:12.833494+0000","last_clean":"2024-03-18T18:09:12.833494+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:12.833494+0000","last_undegraded":"2024-03-18T18:09:12.833494+0000","last_fullsized":"2024-03-18T18:09:12.833494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824575+0000","last_change":"2024-03-18T18:09:12.839993+0000","last_active":"2024-03-18T18:09:13.824575+0000","last_peered":"2024-03-18T18:09:13.824575+0000","last_clean":"2024-03-18T18:09:13.824575+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:09:13.824575+0000","last_undegraded":"2024-03-18T18:09:13.824575+0000","last_fullsized":"2024-03-18T18:09:13.824575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833467+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:12.833467+0000","last_peered":"2024-03-18T18:09:12.833467+0000","last_clean":"2024-03-18T18:09:12.833467+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:12.833467+0000","last_undegraded":"2024-03-18T18:09:12.833467+0000","last_fullsized":"2024-03-18T18:09:12.833467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824588+0000","last_change":"2024-03-18T18:09:12.847998+0000","last_active":"2024-03-18T18:09:13.824588+0000","last_peered":"2024-03-18T18:09:13.824588+0000","last_clean":"2024-03-18T18:09:13.824588+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:09:13.824588+0000","last_undegraded":"2024-03-18T18:09:13.824588+0000","last_fullsized":"2024-03-18T18:09:13.824588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823431+0000","last_change":"2024-03-18T18:09:12.825151+0000","last_active":"2024-03-18T18:09:13.823431+0000","last_peered":"2024-03-18T18:09:13.823431+0000","last_clean":"2024-03-18T18:09:13.823431+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:09:13.823431+0000","last_undegraded":"2024-03-18T18:09:13.823431+0000","last_fullsized":"2024-03-18T18:09:13.823431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833441+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:12.833441+0000","last_peered":"2024-03-18T18:09:12.833441+0000","last_clean":"2024-03-18T18:09:12.833441+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:12.833441+0000","last_undegraded":"2024-03-18T18:09:12.833441+0000","last_fullsized":"2024-03-18T18:09:12.833441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837222+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:12.837222+0000","last_peered":"2024-03-18T18:09:12.837222+0000","last_clean":"2024-03-18T18:09:12.837222+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:12.837222+0000","last_undegraded":"2024-03-18T18:09:12.837222+0000","last_fullsized":"2024-03-18T18:09:12.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825499+0000","last_change":"2024-03-18T18:09:12.848253+0000","last_active":"2024-03-18T18:09:13.825499+0000","last_peered":"2024-03-18T18:09:13.825499+0000","last_clean":"2024-03-18T18:09:13.825499+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:09:13.825499+0000","last_undegraded":"2024-03-18T18:09:13.825499+0000","last_fullsized":"2024-03-18T18:09:13.825499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.844517+0000","last_change":"2024-03-18T18:09:12.843877+0000","last_active":"2024-03-18T18:09:12.844517+0000","last_peered":"2024-03-18T18:09:12.844517+0000","last_clean":"2024-03-18T18:09:12.844517+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:09:12.844517+0000","last_undegraded":"2024-03-18T18:09:12.844517+0000","last_fullsized":"2024-03-18T18:09:12.844517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824113+0000","last_change":"2024-03-18T18:09:12.847460+0000","last_active":"2024-03-18T18:09:13.824113+0000","last_peered":"2024-03-18T18:09:13.824113+0000","last_clean":"2024-03-18T18:09:13.824113+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:09:13.824113+0000","last_undegraded":"2024-03-18T18:09:13.824113+0000","last_fullsized":"2024-03-18T18:09:13.824113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839173+0000","last_change":"2024-03-18T18:09:12.828461+0000","last_active":"2024-03-18T18:09:12.839173+0000","last_peered":"2024-03-18T18:09:12.839173+0000","last_clean":"2024-03-18T18:09:12.839173+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:09:12.839173+0000","last_undegraded":"2024-03-18T18:09:12.839173+0000","last_fullsized":"2024-03-18T18:09:12.839173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837726+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:12.837726+0000","last_peered":"2024-03-18T18:09:12.837726+0000","last_clean":"2024-03-18T18:09:12.837726+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:12.837726+0000","last_undegraded":"2024-03-18T18:09:12.837726+0000","last_fullsized":"2024-03-18T18:09:12.837726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840122+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:12.840122+0000","last_peered":"2024-03-18T18:09:12.840122+0000","last_clean":"2024-03-18T18:09:12.840122+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:12.840122+0000","last_undegraded":"2024-03-18T18:09:12.840122+0000","last_fullsized":"2024-03-18T18:09:12.840122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824203+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:09:13.824203+0000","last_peered":"2024-03-18T18:09:13.824203+0000","last_clean":"2024-03-18T18:09:13.824203+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:09:13.824203+0000","last_undegraded":"2024-03-18T18:09:13.824203+0000","last_fullsized":"2024-03-18T18:09:13.824203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820402+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:12.820402+0000","last_peered":"2024-03-18T18:09:12.820402+0000","last_clean":"2024-03-18T18:09:12.820402+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:12.820402+0000","last_undegraded":"2024-03-18T18:09:12.820402+0000","last_fullsized":"2024-03-18T18:09:12.820402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835017+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:12.835017+0000","last_peered":"2024-03-18T18:09:12.835017+0000","last_clean":"2024-03-18T18:09:12.835017+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:12.835017+0000","last_undegraded":"2024-03-18T18:09:12.835017+0000","last_fullsized":"2024-03-18T18:09:12.835017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824553+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:09:13.824553+0000","last_peered":"2024-03-18T18:09:13.824553+0000","last_clean":"2024-03-18T18:09:13.824553+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:09:13.824553+0000","last_undegraded":"2024-03-18T18:09:13.824553+0000","last_fullsized":"2024-03-18T18:09:13.824553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822841+0000","last_change":"2024-03-18T18:09:12.824723+0000","last_active":"2024-03-18T18:09:13.822841+0000","last_peered":"2024-03-18T18:09:13.822841+0000","last_clean":"2024-03-18T18:09:13.822841+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:09:13.822841+0000","last_undegraded":"2024-03-18T18:09:13.822841+0000","last_fullsized":"2024-03-18T18:09:13.822841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824781+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:09:13.824781+0000","last_peered":"2024-03-18T18:09:13.824781+0000","last_clean":"2024-03-18T18:09:13.824781+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:09:13.824781+0000","last_undegraded":"2024-03-18T18:09:13.824781+0000","last_fullsized":"2024-03-18T18:09:13.824781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824739+0000","last_change":"2024-03-18T18:09:12.843128+0000","last_active":"2024-03-18T18:09:13.824739+0000","last_peered":"2024-03-18T18:09:13.824739+0000","last_clean":"2024-03-18T18:09:13.824739+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:09:13.824739+0000","last_undegraded":"2024-03-18T18:09:13.824739+0000","last_fullsized":"2024-03-18T18:09:13.824739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824800+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:09:13.824800+0000","last_peered":"2024-03-18T18:09:13.824800+0000","last_clean":"2024-03-18T18:09:13.824800+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:09:13.824800+0000","last_undegraded":"2024-03-18T18:09:13.824800+0000","last_fullsized":"2024-03-18T18:09:13.824800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851726+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:12.851726+0000","last_peered":"2024-03-18T18:09:12.851726+0000","last_clean":"2024-03-18T18:09:12.851726+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:12.851726+0000","last_undegraded":"2024-03-18T18:09:12.851726+0000","last_fullsized":"2024-03-18T18:09:12.851726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823072+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:09:13.823072+0000","last_peered":"2024-03-18T18:09:13.823072+0000","last_clean":"2024-03-18T18:09:13.823072+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:09:13.823072+0000","last_undegraded":"2024-03-18T18:09:13.823072+0000","last_fullsized":"2024-03-18T18:09:13.823072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.840231+0000","last_change":"2024-03-18T18:09:12.837565+0000","last_active":"2024-03-18T18:09:12.840231+0000","last_peered":"2024-03-18T18:09:12.840231+0000","last_clean":"2024-03-18T18:09:12.840231+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:09:12.840231+0000","last_undegraded":"2024-03-18T18:09:12.840231+0000","last_fullsized":"2024-03-18T18:09:12.840231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824406+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:09:13.824406+0000","last_peered":"2024-03-18T18:09:13.824406+0000","last_clean":"2024-03-18T18:09:13.824406+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:09:13.824406+0000","last_undegraded":"2024-03-18T18:09:13.824406+0000","last_fullsized":"2024-03-18T18:09:13.824406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224581+0000","last_change":"2024-03-18T18:09:12.830990+0000","last_active":"2024-03-18T18:09:15.224581+0000","last_peered":"2024-03-18T18:09:15.224581+0000","last_clean":"2024-03-18T18:09:15.224581+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:09:15.224581+0000","last_undegraded":"2024-03-18T18:09:15.224581+0000","last_fullsized":"2024-03-18T18:09:15.224581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.843026+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:12.843026+0000","last_peered":"2024-03-18T18:09:12.843026+0000","last_clean":"2024-03-18T18:09:12.843026+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:12.843026+0000","last_undegraded":"2024-03-18T18:09:12.843026+0000","last_fullsized":"2024-03-18T18:09:12.843026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835417+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:12.835417+0000","last_peered":"2024-03-18T18:09:12.835417+0000","last_clean":"2024-03-18T18:09:12.835417+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:12.835417+0000","last_undegraded":"2024-03-18T18:09:12.835417+0000","last_fullsized":"2024-03-18T18:09:12.835417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825559+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:09:13.825559+0000","last_peered":"2024-03-18T18:09:13.825559+0000","last_clean":"2024-03-18T18:09:13.825559+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:09:13.825559+0000","last_undegraded":"2024-03-18T18:09:13.825559+0000","last_fullsized":"2024-03-18T18:09:13.825559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224731+0000","last_change":"2024-03-18T18:09:12.839323+0000","last_active":"2024-03-18T18:09:15.224731+0000","last_peered":"2024-03-18T18:09:15.224731+0000","last_clean":"2024-03-18T18:09:15.224731+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:09:15.224731+0000","last_undegraded":"2024-03-18T18:09:15.224731+0000","last_fullsized":"2024-03-18T18:09:15.224731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824196+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:09:13.824196+0000","last_peered":"2024-03-18T18:09:13.824196+0000","last_clean":"2024-03-18T18:09:13.824196+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:09:13.824196+0000","last_undegraded":"2024-03-18T18:09:13.824196+0000","last_fullsized":"2024-03-18T18:09:13.824196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825747+0000","last_change":"2024-03-18T18:09:12.847297+0000","last_active":"2024-03-18T18:09:13.825747+0000","last_peered":"2024-03-18T18:09:13.825747+0000","last_clean":"2024-03-18T18:09:13.825747+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:09:13.825747+0000","last_undegraded":"2024-03-18T18:09:13.825747+0000","last_fullsized":"2024-03-18T18:09:13.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837921+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:09:12.837921+0000","last_peered":"2024-03-18T18:09:12.837921+0000","last_clean":"2024-03-18T18:09:12.837921+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:09:12.837921+0000","last_undegraded":"2024-03-18T18:09:12.837921+0000","last_fullsized":"2024-03-18T18:09:12.837921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224387+0000","last_change":"2024-03-18T18:09:12.838637+0000","last_active":"2024-03-18T18:09:15.224387+0000","last_peered":"2024-03-18T18:09:15.224387+0000","last_clean":"2024-03-18T18:09:15.224387+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:09:15.224387+0000","last_undegraded":"2024-03-18T18:09:15.224387+0000","last_fullsized":"2024-03-18T18:09:15.224387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835800+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:09:12.835800+0000","last_peered":"2024-03-18T18:09:12.835800+0000","last_clean":"2024-03-18T18:09:12.835800+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:09:12.835800+0000","last_undegraded":"2024-03-18T18:09:12.835800+0000","last_fullsized":"2024-03-18T18:09:12.835800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225074+0000","last_change":"2024-03-18T18:09:12.838775+0000","last_active":"2024-03-18T18:09:15.225074+0000","last_peered":"2024-03-18T18:09:15.225074+0000","last_clean":"2024-03-18T18:09:15.225074+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:09:15.225074+0000","last_undegraded":"2024-03-18T18:09:15.225074+0000","last_fullsized":"2024-03-18T18:09:15.225074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.835337+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:09:12.835337+0000","last_peered":"2024-03-18T18:09:12.835337+0000","last_clean":"2024-03-18T18:09:12.835337+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:09:12.835337+0000","last_undegraded":"2024-03-18T18:09:12.835337+0000","last_fullsized":"2024-03-18T18:09:12.835337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225593+0000","last_change":"2024-03-18T18:09:12.841196+0000","last_active":"2024-03-18T18:09:15.225593+0000","last_peered":"2024-03-18T18:09:15.225593+0000","last_clean":"2024-03-18T18:09:15.225593+0000","last_became_active":"2024-03-18T18:09:12.840659+0000","last_became_peered":"2024-03-18T18:09:12.840659+0000","last_unstale":"2024-03-18T18:09:15.225593+0000","last_undegraded":"2024-03-18T18:09:15.225593+0000","last_fullsized":"2024-03-18T18:09:15.225593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823141+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:09:13.823141+0000","last_peered":"2024-03-18T18:09:13.823141+0000","last_clean":"2024-03-18T18:09:13.823141+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:09:13.823141+0000","last_undegraded":"2024-03-18T18:09:13.823141+0000","last_fullsized":"2024-03-18T18:09:13.823141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825348+0000","last_change":"2024-03-18T18:09:12.834479+0000","last_active":"2024-03-18T18:09:13.825348+0000","last_peered":"2024-03-18T18:09:13.825348+0000","last_clean":"2024-03-18T18:09:13.825348+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:09:13.825348+0000","last_undegraded":"2024-03-18T18:09:13.825348+0000","last_fullsized":"2024-03-18T18:09:13.825348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820127+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:09:12.820127+0000","last_peered":"2024-03-18T18:09:12.820127+0000","last_clean":"2024-03-18T18:09:12.820127+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:09:12.820127+0000","last_undegraded":"2024-03-18T18:09:12.820127+0000","last_fullsized":"2024-03-18T18:09:12.820127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224685+0000","last_change":"2024-03-18T18:09:12.845096+0000","last_active":"2024-03-18T18:09:15.224685+0000","last_peered":"2024-03-18T18:09:15.224685+0000","last_clean":"2024-03-18T18:09:15.224685+0000","last_became_active":"2024-03-18T18:09:12.844794+0000","last_became_peered":"2024-03-18T18:09:12.844794+0000","last_unstale":"2024-03-18T18:09:15.224685+0000","last_undegraded":"2024-03-18T18:09:15.224685+0000","last_fullsized":"2024-03-18T18:09:15.224685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:47.908637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.822307+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:12.822307+0000","last_peered":"2024-03-18T18:09:12.822307+0000","last_clean":"2024-03-18T18:09:12.822307+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:12.822307+0000","last_undegraded":"2024-03-18T18:09:12.822307+0000","last_fullsized":"2024-03-18T18:09:12.822307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824253+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:09:13.824253+0000","last_peered":"2024-03-18T18:09:13.824253+0000","last_clean":"2024-03-18T18:09:13.824253+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:09:13.824253+0000","last_undegraded":"2024-03-18T18:09:13.824253+0000","last_fullsized":"2024-03-18T18:09:13.824253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851080+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:12.851080+0000","last_peered":"2024-03-18T18:09:12.851080+0000","last_clean":"2024-03-18T18:09:12.851080+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:12.851080+0000","last_undegraded":"2024-03-18T18:09:12.851080+0000","last_fullsized":"2024-03-18T18:09:12.851080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224061+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:09:15.224061+0000","last_peered":"2024-03-18T18:09:15.224061+0000","last_clean":"2024-03-18T18:09:15.224061+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:09:15.224061+0000","last_undegraded":"2024-03-18T18:09:15.224061+0000","last_fullsized":"2024-03-18T18:09:15.224061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839841+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:12.839841+0000","last_peered":"2024-03-18T18:09:12.839841+0000","last_clean":"2024-03-18T18:09:12.839841+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:12.839841+0000","last_undegraded":"2024-03-18T18:09:12.839841+0000","last_fullsized":"2024-03-18T18:09:12.839841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.820008+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:09:12.820008+0000","last_peered":"2024-03-18T18:09:12.820008+0000","last_clean":"2024-03-18T18:09:12.820008+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:09:12.820008+0000","last_undegraded":"2024-03-18T18:09:12.820008+0000","last_fullsized":"2024-03-18T18:09:12.820008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822734+0000","last_change":"2024-03-18T18:09:12.822692+0000","last_active":"2024-03-18T18:09:13.822734+0000","last_peered":"2024-03-18T18:09:13.822734+0000","last_clean":"2024-03-18T18:09:13.822734+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:09:13.822734+0000","last_undegraded":"2024-03-18T18:09:13.822734+0000","last_fullsized":"2024-03-18T18:09:13.822734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825607+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:09:13.825607+0000","last_peered":"2024-03-18T18:09:13.825607+0000","last_clean":"2024-03-18T18:09:13.825607+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:09:13.825607+0000","last_undegraded":"2024-03-18T18:09:13.825607+0000","last_fullsized":"2024-03-18T18:09:13.825607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.839446+0000","last_change":"2024-03-18T18:09:12.835734+0000","last_active":"2024-03-18T18:09:12.839446+0000","last_peered":"2024-03-18T18:09:12.839446+0000","last_clean":"2024-03-18T18:09:12.839446+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:09:12.839446+0000","last_undegraded":"2024-03-18T18:09:12.839446+0000","last_fullsized":"2024-03-18T18:09:12.839446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822995+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:09:13.822995+0000","last_peered":"2024-03-18T18:09:13.822995+0000","last_clean":"2024-03-18T18:09:13.822995+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:09:13.822995+0000","last_undegraded":"2024-03-18T18:09:13.822995+0000","last_fullsized":"2024-03-18T18:09:13.822995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824964+0000","last_change":"2024-03-18T18:09:12.842890+0000","last_active":"2024-03-18T18:09:13.824964+0000","last_peered":"2024-03-18T18:09:13.824964+0000","last_clean":"2024-03-18T18:09:13.824964+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:09:13.824964+0000","last_undegraded":"2024-03-18T18:09:13.824964+0000","last_fullsized":"2024-03-18T18:09:13.824964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225099+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:09:15.225099+0000","last_peered":"2024-03-18T18:09:15.225099+0000","last_clean":"2024-03-18T18:09:15.225099+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:09:15.225099+0000","last_undegraded":"2024-03-18T18:09:15.225099+0000","last_fullsized":"2024-03-18T18:09:15.225099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822874+0000","last_change":"2024-03-18T18:09:12.821957+0000","last_active":"2024-03-18T18:09:13.822874+0000","last_peered":"2024-03-18T18:09:13.822874+0000","last_clean":"2024-03-18T18:09:13.822874+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:09:13.822874+0000","last_undegraded":"2024-03-18T18:09:13.822874+0000","last_fullsized":"2024-03-18T18:09:13.822874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823352+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:09:13.823352+0000","last_peered":"2024-03-18T18:09:13.823352+0000","last_clean":"2024-03-18T18:09:13.823352+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:09:13.823352+0000","last_undegraded":"2024-03-18T18:09:13.823352+0000","last_fullsized":"2024-03-18T18:09:13.823352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834965+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:12.834965+0000","last_peered":"2024-03-18T18:09:12.834965+0000","last_clean":"2024-03-18T18:09:12.834965+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:12.834965+0000","last_undegraded":"2024-03-18T18:09:12.834965+0000","last_fullsized":"2024-03-18T18:09:12.834965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824875+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:09:13.824875+0000","last_peered":"2024-03-18T18:09:13.824875+0000","last_clean":"2024-03-18T18:09:13.824875+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:09:13.824875+0000","last_undegraded":"2024-03-18T18:09:13.824875+0000","last_fullsized":"2024-03-18T18:09:13.824875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.832536+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:12.832536+0000","last_peered":"2024-03-18T18:09:12.832536+0000","last_clean":"2024-03-18T18:09:12.832536+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:12.832536+0000","last_undegraded":"2024-03-18T18:09:12.832536+0000","last_fullsized":"2024-03-18T18:09:12.832536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224023+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:09:15.224023+0000","last_peered":"2024-03-18T18:09:15.224023+0000","last_clean":"2024-03-18T18:09:15.224023+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:09:15.224023+0000","last_undegraded":"2024-03-18T18:09:15.224023+0000","last_fullsized":"2024-03-18T18:09:15.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837325+0000","last_change":"2024-03-18T18:09:12.824858+0000","last_active":"2024-03-18T18:09:12.837325+0000","last_peered":"2024-03-18T18:09:12.837325+0000","last_clean":"2024-03-18T18:09:12.837325+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:09:12.837325+0000","last_undegraded":"2024-03-18T18:09:12.837325+0000","last_fullsized":"2024-03-18T18:09:12.837325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823079+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:09:13.823079+0000","last_peered":"2024-03-18T18:09:13.823079+0000","last_clean":"2024-03-18T18:09:13.823079+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:09:13.823079+0000","last_undegraded":"2024-03-18T18:09:13.823079+0000","last_fullsized":"2024-03-18T18:09:13.823079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.833573+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:12.833573+0000","last_peered":"2024-03-18T18:09:12.833573+0000","last_clean":"2024-03-18T18:09:12.833573+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:12.833573+0000","last_undegraded":"2024-03-18T18:09:12.833573+0000","last_fullsized":"2024-03-18T18:09:12.833573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823186+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:09:13.823186+0000","last_peered":"2024-03-18T18:09:13.823186+0000","last_clean":"2024-03-18T18:09:13.823186+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:09:13.823186+0000","last_undegraded":"2024-03-18T18:09:13.823186+0000","last_fullsized":"2024-03-18T18:09:13.823186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.834995+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:12.834995+0000","last_peered":"2024-03-18T18:09:12.834995+0000","last_clean":"2024-03-18T18:09:12.834995+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:12.834995+0000","last_undegraded":"2024-03-18T18:09:12.834995+0000","last_fullsized":"2024-03-18T18:09:12.834995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224945+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:09:15.224945+0000","last_peered":"2024-03-18T18:09:15.224945+0000","last_clean":"2024-03-18T18:09:15.224945+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:09:15.224945+0000","last_undegraded":"2024-03-18T18:09:15.224945+0000","last_fullsized":"2024-03-18T18:09:15.224945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824060+0000","last_change":"2024-03-18T18:09:12.842987+0000","last_active":"2024-03-18T18:09:13.824060+0000","last_peered":"2024-03-18T18:09:13.824060+0000","last_clean":"2024-03-18T18:09:13.824060+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:09:13.824060+0000","last_undegraded":"2024-03-18T18:09:13.824060+0000","last_fullsized":"2024-03-18T18:09:13.824060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824811+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824811+0000","last_peered":"2024-03-18T18:09:13.824811+0000","last_clean":"2024-03-18T18:09:13.824811+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:09:13.824811+0000","last_undegraded":"2024-03-18T18:09:13.824811+0000","last_fullsized":"2024-03-18T18:09:13.824811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224645+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:09:15.224645+0000","last_peered":"2024-03-18T18:09:15.224645+0000","last_clean":"2024-03-18T18:09:15.224645+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:09:15.224645+0000","last_undegraded":"2024-03-18T18:09:15.224645+0000","last_fullsized":"2024-03-18T18:09:15.224645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825111+0000","last_change":"2024-03-18T18:09:12.849269+0000","last_active":"2024-03-18T18:09:13.825111+0000","last_peered":"2024-03-18T18:09:13.825111+0000","last_clean":"2024-03-18T18:09:13.825111+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:09:13.825111+0000","last_undegraded":"2024-03-18T18:09:13.825111+0000","last_fullsized":"2024-03-18T18:09:13.825111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224838+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:09:15.224838+0000","last_peered":"2024-03-18T18:09:15.224838+0000","last_clean":"2024-03-18T18:09:15.224838+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:09:15.224838+0000","last_undegraded":"2024-03-18T18:09:15.224838+0000","last_fullsized":"2024-03-18T18:09:15.224838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.851751+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:12.851751+0000","last_peered":"2024-03-18T18:09:12.851751+0000","last_clean":"2024-03-18T18:09:12.851751+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:12.851751+0000","last_undegraded":"2024-03-18T18:09:12.851751+0000","last_fullsized":"2024-03-18T18:09:12.851751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837411+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:12.837411+0000","last_peered":"2024-03-18T18:09:12.837411+0000","last_clean":"2024-03-18T18:09:12.837411+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:12.837411+0000","last_undegraded":"2024-03-18T18:09:12.837411+0000","last_fullsized":"2024-03-18T18:09:12.837411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.850617+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:12.850617+0000","last_peered":"2024-03-18T18:09:12.850617+0000","last_clean":"2024-03-18T18:09:12.850617+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:12.850617+0000","last_undegraded":"2024-03-18T18:09:12.850617+0000","last_fullsized":"2024-03-18T18:09:12.850617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.837648+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:12.837648+0000","last_peered":"2024-03-18T18:09:12.837648+0000","last_clean":"2024-03-18T18:09:12.837648+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:12.837648+0000","last_undegraded":"2024-03-18T18:09:12.837648+0000","last_fullsized":"2024-03-18T18:09:12.837648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":660518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":5,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":69568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":69728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":71132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":660574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:20.570 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-18T18:09:20.570 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-18T18:09:20.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-18T18:09:20.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-18T18:09:20.571 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-18T18:09:20.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 Processor -- start 2024-03-18T18:09:20.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 -- start start 2024-03-18T18:09:20.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdd44071b50 0x7fdd441478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdd44147e00 0x7fdd440b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440b0a70 con 0x7fdd440b2c20 2024-03-18T18:09:20.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4413eaf0 con 0x7fdd44147e00 2024-03-18T18:09:20.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4ad72700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd44071f30 con 0x7fdd44071b50 2024-03-18T18:09:20.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4956f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdd44147e00 0x7fdd440b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4956f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdd44147e00 0x7fdd440b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35202/0 (socket says 172.21.15.94:35202) 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd4956f700 1 -- 172.21.15.94:0/518672404 learned_addr learned my addr 172.21.15.94:0/518672404 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.676+0000 7fdd49d70700 1 --2- 172.21.15.94:0/518672404 >> v2:172.21.15.151:3300/0 conn(0x7fdd44071b50 0x7fdd441478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4956f700 1 -- 172.21.15.94:0/518672404 >> v2:172.21.15.151:3300/0 conn(0x7fdd44071b50 msgr2=0x7fdd441478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4956f700 1 --2- 172.21.15.94:0/518672404 >> v2:172.21.15.151:3300/0 conn(0x7fdd44071b50 0x7fdd441478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4956f700 1 -- 172.21.15.94:0/518672404 >> v1:172.21.15.151:6789/0 conn(0x7fdd440b2c20 legacy=0x7fdd4406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4956f700 1 -- 172.21.15.94:0/518672404 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440b35a0 con 0x7fdd44147e00 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4956f700 1 --2- 172.21.15.94:0/518672404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd44147e00 0x7fdd440b26e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdd44072230 tx=0x7fdd34009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4577a3244d39e37 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd48d6e700 1 -- 172.21.15.94:0/518672404 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400b8a0 con 0x7fdd44147e00 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd48d6e700 1 -- 172.21.15.94:0/518672404 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400ba00 con 0x7fdd44147e00 2024-03-18T18:09:20.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd48d6e700 1 -- 172.21.15.94:0/518672404 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400bd90 con 0x7fdd44147e00 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 -- 172.21.15.94:0/518672404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd44147e00 msgr2=0x7fdd440b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/518672404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd44147e00 0x7fdd440b26e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdd44072230 tx=0x7fdd34009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 -- 172.21.15.94:0/518672404 shutdown_connections 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/518672404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd44147e00 0x7fdd440b26e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/518672404 >> v2:172.21.15.151:3300/0 conn(0x7fdd44071b50 0x7fdd441478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 -- 172.21.15.94:0/518672404 >> 172.21.15.94:0/518672404 conn(0x7fdd440b56a0 msgr2=0x7fdd440b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:20.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 -- 172.21.15.94:0/518672404 shutdown_connections 2024-03-18T18:09:20.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.680+0000 7fdd4ad72700 1 -- 172.21.15.94:0/518672404 wait complete. 2024-03-18T18:09:20.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 Processor -- start 2024-03-18T18:09:20.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 -- start start 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd44071b50 0x7fdd4413a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 0x7fdd4413a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd44147e00 0x7fdd441d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd441415f0 con 0x7fdd440b2c20 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4413f1e0 con 0x7fdd44147e00 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd441403a0 con 0x7fdd44071b50 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 0x7fdd4413a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 0x7fdd4413a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35214/0 (socket says 172.21.15.94:35214) 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 -- 172.21.15.94:0/3540889554 learned_addr learned my addr 172.21.15.94:0/3540889554 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd49d70700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd44071b50 0x7fdd4413a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4a571700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd44147e00 0x7fdd441d92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 -- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd44071b50 msgr2=0x7fdd4413a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd44071b50 0x7fdd4413a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 -- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd44147e00 msgr2=0x7fdd441d92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd44147e00 0x7fdd441d92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 -- 172.21.15.94:0/3540889554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009570 con 0x7fdd440b2c20 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4956f700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 0x7fdd4413a5d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340038c0 con 0x7fdd440b2c20 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.684+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd44140680 con 0x7fdd440b2c20 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3401e070 con 0x7fdd440b2c20 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34003c40 con 0x7fdd440b2c20 2024-03-18T18:09:20.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4413f9b0 con 0x7fdd440b2c20 2024-03-18T18:09:20.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd44067620 con 0x7fdd440b2c20 2024-03-18T18:09:20.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdd34020030 con 0x7fdd440b2c20 2024-03-18T18:09:20.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd3a7fc700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdd28066730 0x7fdd28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:20.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd34085390 con 0x7fdd440b2c20 2024-03-18T18:09:20.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd49d70700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdd28066730 0x7fdd28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:20.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.688+0000 7fdd49d70700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdd28066730 0x7fdd28068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009950 tx=0x7fdd40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:20.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.696+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdd34052670 con 0x7fdd440b2c20 2024-03-18T18:09:20.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.912+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdd4413ef00 con 0x7fdd440b2c20 2024-03-18T18:09:20.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.912+0000 7fdd3a7fc700 1 -- 172.21.15.94:0/3540889554 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+164872 (secure 0 0 0) 0x7fdd4413ef00 con 0x7fdd440b2c20 2024-03-18T18:09:20.921 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:20.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdd28066730 msgr2=0x7fdd28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdd28066730 0x7fdd28068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009950 tx=0x7fdd40008040 comp rx=0 tx=0).stop 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 msgr2=0x7fdd4413a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 0x7fdd4413a5d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34004770 comp rx=0 tx=0).stop 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 shutdown_connections 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdd28066730 0x7fdd28068bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd44147e00 0x7fdd441d92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdd440b2c20 0x7fdd4413a5d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 --2- 172.21.15.94:0/3540889554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd44071b50 0x7fdd4413a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 >> 172.21.15.94:0/3540889554 conn(0x7fdd440b56a0 msgr2=0x7fdd4406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 shutdown_connections 2024-03-18T18:09:20.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:20.916+0000 7fdd4ad72700 1 -- 172.21.15.94:0/3540889554 wait complete. 2024-03-18T18:09:20.934 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":25889},{"type":"v1","addr":"172.21.15.94:6833","nonce":25889}]},"active_addr":"172.21.15.94:6833/25889","active_change":"2024-03-18T18:08:52.541660+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4117,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":773740730}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":379347233}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":904561310}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2112164257}]}]} 2024-03-18T18:09:20.938 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-18T18:09:20.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T18:09:20.938 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:21.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 Processor -- start 2024-03-18T18:09:21.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- start start 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f9190152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919009b1a0 con 0x7f919009aa90 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919009ae70 con 0x7f91900b8310 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9190099e10 con 0x7f91900b2e70 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919581b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f919009aa90 0x7f91901406f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56738/0 (socket says 172.21.15.94:56738) 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919581b700 1 -- 172.21.15.94:0/1326619073 learned_addr learned my addr 172.21.15.94:0/1326619073 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919601c700 1 --2- 172.21.15.94:0/1326619073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f9190152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758945655 0 0) 0x7f919009b1a0 con 0x7f919009aa90 2024-03-18T18:09:21.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f917c0035d0 con 0x7f919009aa90 2024-03-18T18:09:21.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276508957 0 0) 0x7f919009ae70 con 0x7f91900b8310 2024-03-18T18:09:21.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f919009b1a0 con 0x7f91900b8310 2024-03-18T18:09:21.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919601c700 1 -- 172.21.15.94:0/1326619073 >> v1:172.21.15.151:6789/0 conn(0x7f91900b8310 legacy=0x7f91900b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919601c700 1 -- 172.21.15.94:0/1326619073 >> v1:172.21.15.94:6789/0 conn(0x7f919009aa90 legacy=0x7f91901406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919601c700 1 -- 172.21.15.94:0/1326619073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919009a0f0 con 0x7f91900b2e70 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f919601c700 1 --2- 172.21.15.94:0/1326619073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f9190152000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9188009dc0 tx=0x7f918800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a337bfb8b553e61 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800e070 con 0x7f91900b2e70 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918800bb20 con 0x7f91900b2e70 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9194819700 1 -- 172.21.15.94:0/1326619073 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188012430 con 0x7f91900b2e70 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- 172.21.15.94:0/1326619073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 msgr2=0x7f9190152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 --2- 172.21.15.94:0/1326619073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f9190152000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9188009dc0 tx=0x7f918800b330 comp rx=0 tx=0).stop 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- 172.21.15.94:0/1326619073 shutdown_connections 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 --2- 172.21.15.94:0/1326619073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f9190152000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- 172.21.15.94:0/1326619073 >> 172.21.15.94:0/1326619073 conn(0x7f91900b8a40 msgr2=0x7f91900b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- 172.21.15.94:0/1326619073 shutdown_connections 2024-03-18T18:09:21.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.048+0000 7f9197a7f700 1 -- 172.21.15.94:0/1326619073 wait complete. 2024-03-18T18:09:21.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 Processor -- start 2024-03-18T18:09:21.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 -- start start 2024-03-18T18:09:21.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 0x7f9190146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f91900a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91900b8310 0x7f91900a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900a1ae0 con 0x7f919009aa90 2024-03-18T18:09:21.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190149200 con 0x7f91900b8310 2024-03-18T18:09:21.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9190148f20 con 0x7f91900b2e70 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 0x7f9190146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 0x7f9190146b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35226/0 (socket says 172.21.15.94:35226) 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 -- 172.21.15.94:0/2756925347 learned_addr learned my addr 172.21.15.94:0/2756925347 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919501a700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f91900a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919601c700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91900b8310 0x7f91900a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 -- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 msgr2=0x7f91900a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f91900a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 -- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91900b8310 msgr2=0x7f91900a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91900b8310 0x7f91900a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 -- 172.21.15.94:0/2756925347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009a70 con 0x7f919009aa90 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f919581b700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 0x7f9190146b00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c700 tx=0x7f918c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c005d90 con 0x7f919009aa90 2024-03-18T18:09:21.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c0070d0 con 0x7f919009aa90 2024-03-18T18:09:21.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91901474a0 con 0x7f919009aa90 2024-03-18T18:09:21.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c007480 con 0x7f919009aa90 2024-03-18T18:09:21.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.052+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9190147a90 con 0x7f919009aa90 2024-03-18T18:09:21.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.056+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190148210 con 0x7f919009aa90 2024-03-18T18:09:21.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.056+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f918c0075e0 con 0x7f919009aa90 2024-03-18T18:09:21.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.056+0000 7f91867fc700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9174066760 0x7f9174068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.056+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f918c0834c0 con 0x7f919009aa90 2024-03-18T18:09:21.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.056+0000 7f919501a700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9174066760 0x7f9174068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.056+0000 7f919501a700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9174066760 0x7f9174068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f91901473e0 tx=0x7f9180009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.068+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f918c0508c0 con 0x7f919009aa90 2024-03-18T18:09:21.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.236+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91900a1940 con 0x7f919009aa90 2024-03-18T18:09:21.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f91867fc700 1 -- 172.21.15.94:0/2756925347 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f91900a1940 con 0x7f919009aa90 2024-03-18T18:09:21.239 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:21.240 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":22,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:13.808682+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9174066760 msgr2=0x7f9174068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9174066760 0x7f9174068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f91901473e0 tx=0x7f9180009040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 msgr2=0x7f9190146b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 0x7f9190146b00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c700 tx=0x7f918c00ca10 comp rx=0 tx=0).stop 2024-03-18T18:09:21.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 shutdown_connections 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9174066760 0x7f9174068c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91900b8310 0x7f91900a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f91900b2e70 0x7f91900a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 --2- 172.21.15.94:0/2756925347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f919009aa90 0x7f9190146b00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 >> 172.21.15.94:0/2756925347 conn(0x7f91900b8a40 msgr2=0x7f91900665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 shutdown_connections 2024-03-18T18:09:21.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.240+0000 7f9197a7f700 1 -- 172.21.15.94:0/2756925347 wait complete. 2024-03-18T18:09:21.255 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T18:09:21.255 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:21.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd703566700 1 Processor -- start 2024-03-18T18:09:21.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd703566700 1 -- start start 2024-03-18T18:09:21.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd703566700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06cad0 0x7fd6fc14df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd703566700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc070ec0 con 0x7fd6fc06fbf0 2024-03-18T18:09:21.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd703566700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc071350 con 0x7fd6fc06f790 2024-03-18T18:09:21.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd703566700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc06ceb0 con 0x7fd6fc06cad0 2024-03-18T18:09:21.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702d65700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd6fc06fbf0 0x7fd6fc155310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56754/0 (socket says 172.21.15.94:56754) 2024-03-18T18:09:21.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702d65700 1 -- 172.21.15.94:0/4215175118 learned_addr learned my addr 172.21.15.94:0/4215175118 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702564700 1 --2- 172.21.15.94:0/4215175118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06cad0 0x7fd6fc14df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd701562700 1 -- 172.21.15.94:0/4215175118 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397092957 0 0) 0x7fd6fc070ec0 con 0x7fd6fc06fbf0 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd701562700 1 -- 172.21.15.94:0/4215175118 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e40035d0 con 0x7fd6fc06fbf0 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd701562700 1 -- 172.21.15.94:0/4215175118 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480232512 0 0) 0x7fd6fc071350 con 0x7fd6fc06f790 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702564700 1 -- 172.21.15.94:0/4215175118 >> v1:172.21.15.151:6789/0 conn(0x7fd6fc06f790 legacy=0x7fd6fc144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702564700 1 -- 172.21.15.94:0/4215175118 >> v1:172.21.15.94:6789/0 conn(0x7fd6fc06fbf0 legacy=0x7fd6fc155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702564700 1 -- 172.21.15.94:0/4215175118 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0715f0 con 0x7fd6fc06cad0 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd702564700 1 --2- 172.21.15.94:0/4215175118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06cad0 0x7fd6fc14df80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009880 tx=0x7fd6f0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5279b70f1fdcf288 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd701562700 1 -- 172.21.15.94:0/4215175118 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011830 con 0x7fd6fc06cad0 2024-03-18T18:09:21.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd701562700 1 -- 172.21.15.94:0/4215175118 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0011990 con 0x7fd6fc06cad0 2024-03-18T18:09:21.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.364+0000 7fd701562700 1 -- 172.21.15.94:0/4215175118 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0011d20 con 0x7fd6fc06cad0 2024-03-18T18:09:21.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- 172.21.15.94:0/4215175118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06cad0 msgr2=0x7fd6fc14df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 --2- 172.21.15.94:0/4215175118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06cad0 0x7fd6fc14df80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009880 tx=0x7fd6f0009b90 comp rx=0 tx=0).stop 2024-03-18T18:09:21.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- 172.21.15.94:0/4215175118 shutdown_connections 2024-03-18T18:09:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 --2- 172.21.15.94:0/4215175118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06cad0 0x7fd6fc14df80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- 172.21.15.94:0/4215175118 >> 172.21.15.94:0/4215175118 conn(0x7fd6fc0b5610 msgr2=0x7fd6fc0b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- 172.21.15.94:0/4215175118 shutdown_connections 2024-03-18T18:09:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- 172.21.15.94:0/4215175118 wait complete. 2024-03-18T18:09:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 Processor -- start 2024-03-18T18:09:21.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- start start 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc06cad0 0x7fd6fc1dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06f790 0x7fd6fc1428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 0x7fd6fc13e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc13e3a0 con 0x7fd6fc06fbf0 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b0df0 con 0x7fd6fc06cad0 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd703566700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1395c0 con 0x7fd6fc06f790 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.368+0000 7fd702d65700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 0x7fd6fc13e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd702564700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc06cad0 0x7fd6fc1dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06f790 0x7fd6fc1428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd702d65700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 0x7fd6fc13e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35230/0 (socket says 172.21.15.94:35230) 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd702d65700 1 -- 172.21.15.94:0/3888657746 learned_addr learned my addr 172.21.15.94:0/3888657746 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 -- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc06cad0 msgr2=0x7fd6fc1dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc06cad0 0x7fd6fc1dfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 -- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 msgr2=0x7fd6fc13e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 0x7fd6fc13e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 -- 172.21.15.94:0/3888657746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00094b0 con 0x7fd6fc06f790 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd702d65700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 0x7fd6fc13e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd701d63700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06f790 0x7fd6fc1428e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00c4e0 tx=0x7fd6ec00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0054e0 con 0x7fd6fc06f790 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0036a0 con 0x7fd6fc06f790 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc072250 con 0x7fd6fc06f790 2024-03-18T18:09:21.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec003a50 con 0x7fd6fc06f790 2024-03-18T18:09:21.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc143300 con 0x7fd6fc06f790 2024-03-18T18:09:21.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.372+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc1e0340 con 0x7fd6fc06f790 2024-03-18T18:09:21.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.376+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd6ec003bb0 con 0x7fd6fc06f790 2024-03-18T18:09:21.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.376+0000 7fd6faffd700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6e8066760 0x7fd6e8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.376+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6ec083a90 con 0x7fd6fc06f790 2024-03-18T18:09:21.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.376+0000 7fd702564700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6e8066760 0x7fd6e8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.376+0000 7fd702564700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6e8066760 0x7fd6e8068c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00090b0 tx=0x7fd6f001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.384+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd6ec050e00 con 0x7fd6fc06f790 2024-03-18T18:09:21.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.552+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6fc067620 con 0x7fd6fc06f790 2024-03-18T18:09:21.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.556+0000 7fd6faffd700 1 -- 172.21.15.94:0/3888657746 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fd6ec017020 con 0x7fd6fc06f790 2024-03-18T18:09:21.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:21.557 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":22,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:13.808682+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6e8066760 msgr2=0x7fd6e8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6e8066760 0x7fd6e8068c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00090b0 tx=0x7fd6f001c040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06f790 msgr2=0x7fd6fc1428e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06f790 0x7fd6fc1428e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00c4e0 tx=0x7fd6ec00c7f0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 shutdown_connections 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd6e8066760 0x7fd6e8068c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd6fc06fbf0 0x7fd6fc13e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc06f790 0x7fd6fc1428e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 --2- 172.21.15.94:0/3888657746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc06cad0 0x7fd6fc1dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 >> 172.21.15.94:0/3888657746 conn(0x7fd6fc0b5610 msgr2=0x7fd6fc0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 shutdown_connections 2024-03-18T18:09:21.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.560+0000 7fd703566700 1 -- 172.21.15.94:0/3888657746 wait complete. 2024-03-18T18:09:21.578 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-18T18:09:21.579 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-18T18:09:21.579 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-18T18:09:21.579 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-18T18:09:21.580 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-18T18:09:21.580 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-18T18:09:21.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-18T18:09:21.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-18T18:09:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 Processor -- start 2024-03-18T18:09:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 Processor -- start 2024-03-18T18:09:21.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 -- start start 2024-03-18T18:09:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 -- start start 2024-03-18T18:09:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f519406a3c0 0x7f51940b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f87e00b8480 0x7f87e00af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.730 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 0x7f87e0144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00b8860 con 0x7f87e0144d70 2024-03-18T18:09:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e0145200 con 0x7f87e00b8480 2024-03-18T18:09:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e852e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00b0fe0 con 0x7f87e00ae9f0 2024-03-18T18:09:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5194153210 0x7f5194155600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.731 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51940b22e0 con 0x7f51940b47f0 2024-03-18T18:09:21.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51940b3110 con 0x7f5194153210 2024-03-18T18:09:21.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51992b1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519406a7a0 con 0x7f519406a3c0 2024-03-18T18:09:21.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f6ce9a07700 1 Processor -- start 2024-03-18T18:09:21.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51937fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5194153210 0x7f5194155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f6ce9a07700 1 -- start start 2024-03-18T18:09:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51937fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5194153210 0x7f5194155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35242/0 (socket says 172.21.15.94:35242) 2024-03-18T18:09:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f51937fe700 1 -- 172.21.15.94:0/1780553140 learned_addr learned my addr 172.21.15.94:0/1780553140 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f5192ffd700 1 --2- 172.21.15.94:0/1780553140 >> v2:172.21.15.151:3300/0 conn(0x7f519406a3c0 0x7f51940b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e6acb700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f87e0144d70 0x7f87e014df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:49214/0 (socket says 172.21.15.94:49214) 2024-03-18T18:09:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.728+0000 7f87e6acb700 1 -- 172.21.15.94:0/1366714533 learned_addr learned my addr 172.21.15.94:0/1366714533 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4142520 0x7f6ce40af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ce406cc80 0x7f6ce40b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f5191ffb700 1 -- 172.21.15.94:0/1780553140 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247258789 0 0) 0x7f51940b22e0 con 0x7f51940b47f0 2024-03-18T18:09:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f5191ffb700 1 -- 172.21.15.94:0/1780553140 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f517c0035d0 con 0x7f51940b47f0 2024-03-18T18:09:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51937fe700 1 -- 172.21.15.94:0/1780553140 >> v2:172.21.15.151:3300/0 conn(0x7f519406a3c0 msgr2=0x7f51940b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51937fe700 1 --2- 172.21.15.94:0/1780553140 >> v2:172.21.15.151:3300/0 conn(0x7f519406a3c0 0x7f51940b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51937fe700 1 -- 172.21.15.94:0/1780553140 >> v1:172.21.15.94:6789/0 conn(0x7f51940b47f0 legacy=0x7f519414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51937fe700 1 -- 172.21.15.94:0/1780553140 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51940b2b50 con 0x7f5194153210 2024-03-18T18:09:21.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548388174 0 0) 0x7f87e00b8860 con 0x7f87e0144d70 2024-03-18T18:09:21.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87cc0035d0 con 0x7f87e0144d70 2024-03-18T18:09:21.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40b43a0 con 0x7f6ce40b0310 2024-03-18T18:09:21.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e5ac9700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 0x7f87e0144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce4072340 con 0x7f6ce406cc80 2024-03-18T18:09:21.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b0df0 con 0x7f6ce4142520 2024-03-18T18:09:21.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ce406cc80 0x7f6ce40b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ce406cc80 0x7f6ce40b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35258/0 (socket says 172.21.15.94:35258) 2024-03-18T18:09:21.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 -- 172.21.15.94:0/3679564757 learned_addr learned my addr 172.21.15.94:0/3679564757 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e62ca700 1 --2- 172.21.15.94:0/1366714533 >> v2:172.21.15.94:3300/0 conn(0x7f87e00b8480 0x7f87e00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51937fe700 1 --2- 172.21.15.94:0/1780553140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f5194155600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f519406afa0 tx=0x7f5184009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdc65835fab7805 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 -- 172.21.15.94:0/3679564757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4142520 msgr2=0x7f6ce40af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce2ffd700 1 --2- 172.21.15.94:0/3679564757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4142520 0x7f6ce40af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.738 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 983983300 0 0) 0x7f87cc0035d0 con 0x7f87e0144d70 2024-03-18T18:09:21.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 msgr2=0x7f87e0144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 0x7f87e0144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 >> v2:172.21.15.94:3300/0 conn(0x7f87e00b8480 msgr2=0x7f87e00af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 --2- 172.21.15.94:0/3679564757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4142520 0x7f6ce40af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 -- 172.21.15.94:0/3679564757 >> v1:172.21.15.151:6789/0 conn(0x7f6ce40b0310 legacy=0x7f6ce4071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 --2- 172.21.15.94:0/1366714533 >> v2:172.21.15.94:3300/0 conn(0x7f87e00b8480 0x7f87e00af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00b43e0 con 0x7f87e0144d70 2024-03-18T18:09:21.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e62ca700 1 --2- 172.21.15.94:0/1366714533 >> v2:172.21.15.94:3300/0 conn(0x7f87e00b8480 0x7f87e00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:21.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f87dc001670 con 0x7f87e0144d70 2024-03-18T18:09:21.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 -- 172.21.15.94:0/3679564757 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40b0830 con 0x7f6ce406cc80 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce27fc700 1 --2- 172.21.15.94:0/3679564757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce406cc80 0x7f6ce40b8210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009910 tx=0x7f6cd4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54db43bcbb3e692 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 >> v1:172.21.15.151:6789/0 conn(0x7f87e0144d70 legacy=0x7f87e014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 0x7f87cc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87cc003ff0 0x7f87cc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc004db0 0x7f87cc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0145200 con 0x7f87cc004db0 2024-03-18T18:09:21.741 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc00ba60 con 0x7f87cc003ff0 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc00bc20 con 0x7f87e00ae9f0 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc004db0 0x7f87cc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e5ac9700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87cc003ff0 0x7f87cc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e62ca700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 0x7f87cc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 Processor -- start 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f5191ffb700 1 -- 172.21.15.94:0/1780553140 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184011830 con 0x7f5194153210 2024-03-18T18:09:21.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f5191ffb700 1 -- 172.21.15.94:0/1780553140 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5184011990 con 0x7f5194153210 2024-03-18T18:09:21.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f5191ffb700 1 -- 172.21.15.94:0/1780553140 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184011d20 con 0x7f5194153210 2024-03-18T18:09:21.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb532a700 1 Processor -- start 2024-03-18T18:09:21.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb532a700 1 -- start start 2024-03-18T18:09:21.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 -- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 msgr2=0x7f87cc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87e00ae9f0 0x7f87cc003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 -- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87cc003ff0 msgr2=0x7f87cc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87cc003ff0 0x7f87cc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 -- 172.21.15.94:0/1366714533 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0035d0 con 0x7f87cc004db0 2024-03-18T18:09:21.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb532a700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbfb0155830 0x7fbfb0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce1ffb700 1 -- 172.21.15.94:0/3679564757 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400ba60 con 0x7f6ce406cc80 2024-03-18T18:09:21.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce1ffb700 1 -- 172.21.15.94:0/3679564757 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400bbc0 con 0x7f6ce406cc80 2024-03-18T18:09:21.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce1ffb700 1 -- 172.21.15.94:0/3679564757 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4009e60 con 0x7f6ce406cc80 2024-03-18T18:09:21.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 -- 172.21.15.94:0/1780553140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 msgr2=0x7f5194155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 --2- 172.21.15.94:0/1780553140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f5194155600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f519406afa0 tx=0x7f5184009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb532a700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00b0820 con 0x7fbfb00b4ab0 2024-03-18T18:09:21.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb532a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00b4e90 con 0x7fbfb0156200 2024-03-18T18:09:21.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb532a700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb00aedb0 con 0x7fbfb0155830 2024-03-18T18:09:21.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 -- start start 2024-03-18T18:09:21.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e6acb700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc004db0 0x7f87cc005230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00c210 tx=0x7f87cc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636b0c188423b6ce server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 -- 172.21.15.94:0/1780553140 shutdown_connections 2024-03-18T18:09:21.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb4b29700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbfb0156200 0x7fbfb015ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:49236/0 (socket says 172.21.15.94:49236) 2024-03-18T18:09:21.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfb4b29700 1 -- 172.21.15.94:0/3154575504 learned_addr learned my addr 172.21.15.94:0/3154575504 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 --2- 172.21.15.94:0/1780553140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f5194155600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 --2- 172.21.15.94:0/1780553140 >> v2:172.21.15.151:3300/0 conn(0x7f519406a3c0 0x7f51940b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.747 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 -- 172.21.15.94:0/1780553140 >> 172.21.15.94:0/1780553140 conn(0x7f51940b8ba0 msgr2=0x7f51940b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 -- 172.21.15.94:0/3679564757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce406cc80 msgr2=0x7f6ce40b8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 --2- 172.21.15.94:0/3679564757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce406cc80 0x7f6ce40b8210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009910 tx=0x7f6cd4009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:21.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 -- 172.21.15.94:0/1780553140 shutdown_connections 2024-03-18T18:09:21.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaf7fe700 1 --2- 172.21.15.94:0/3154575504 >> v2:172.21.15.94:3300/0 conn(0x7fbfb0155830 0x7fbfb0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005782382 0 0) 0x7fbfb00b4e90 con 0x7fbfb0156200 2024-03-18T18:09:21.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf980035d0 con 0x7fbfb0156200 2024-03-18T18:09:21.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00cd50 con 0x7f87cc004db0 2024-03-18T18:09:21.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc007b30 con 0x7f87cc004db0 2024-03-18T18:09:21.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f87e52c8700 1 -- 172.21.15.94:0/1366714533 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc005ba0 con 0x7f87cc004db0 2024-03-18T18:09:21.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f51992b1700 1 -- 172.21.15.94:0/1780553140 wait complete. 2024-03-18T18:09:21.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2505006168 0 0) 0x7fbf980035d0 con 0x7fbfb0156200 2024-03-18T18:09:21.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 >> v2:172.21.15.94:3300/0 conn(0x7fbfb0155830 msgr2=0x7fbfb0155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaeffd700 1 --2- 172.21.15.94:0/3154575504 >> v2:172.21.15.94:3300/0 conn(0x7fbfb0155830 0x7fbfb0155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 >> v1:172.21.15.94:6789/0 conn(0x7fbfb00b4ab0 legacy=0x7fbfb00b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd7e8071960 0x7fd7e8071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e814cc50 0x7fd7e814f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8072350 con 0x7fd7e80b8480 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80b1eb0 con 0x7fd7e8071960 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7fd7ef276700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80b2500 con 0x7fd7e814cc50 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 -- 172.21.15.94:0/3679564757 shutdown_connections 2024-03-18T18:09:21.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 --2- 172.21.15.94:0/3679564757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce406cc80 0x7f6ce40b8210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1695d8700 1 Processor -- start 2024-03-18T18:09:21.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- 172.21.15.94:0/1366714533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc004db0 msgr2=0x7f87cc005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 --2- 172.21.15.94:0/1366714533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87cc004db0 0x7f87cc005230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00c210 tx=0x7f87cc0058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e6acb700 1 -- 172.21.15.94:0/1366714533 reap_dead start 2024-03-18T18:09:21.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd7e8071960 0x7fd7e8071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ed012700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd7e80b8480 0x7fd7e8144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56776/0 (socket says 172.21.15.94:56776) 2024-03-18T18:09:21.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd7e8071960 0x7fd7e8071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35276/0 (socket says 172.21.15.94:35276) 2024-03-18T18:09:21.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ed012700 1 -- 172.21.15.94:0/304269732 learned_addr learned my addr 172.21.15.94:0/304269732 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.732+0000 7f6ce9a07700 1 --2- 172.21.15.94:0/3679564757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4142520 0x7f6ce40af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- 172.21.15.94:0/1366714533 shutdown_connections 2024-03-18T18:09:21.753 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- 172.21.15.94:0/1366714533 >> 172.21.15.94:0/1366714533 conn(0x7f87e006a780 msgr2=0x7f87e00b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0156630 con 0x7fbfb0156200 2024-03-18T18:09:21.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1695d8700 1 -- start start 2024-03-18T18:09:21.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- 172.21.15.94:0/1366714533 shutdown_connections 2024-03-18T18:09:21.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- 172.21.15.94:0/1366714533 wait complete. 2024-03-18T18:09:21.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 Processor -- start 2024-03-18T18:09:21.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 -- start start 2024-03-18T18:09:21.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f6ce9a07700 1 -- 172.21.15.94:0/3679564757 >> 172.21.15.94:0/3679564757 conn(0x7f6ce406a780 msgr2=0x7f6ce40b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7dffff700 1 -- 172.21.15.94:0/304269732 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008106500 0 0) 0x7fd7e8072350 con 0x7fd7e80b8480 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7dffff700 1 -- 172.21.15.94:0/304269732 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d40035d0 con 0x7fd7e80b8480 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 -- 172.21.15.94:0/304269732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e814cc50 msgr2=0x7fd7e814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7dffff700 1 -- 172.21.15.94:0/304269732 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2359715079 0 0) 0x7fd7d40035d0 con 0x7fd7e80b8480 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ed813700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e814cc50 0x7fd7e814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e814cc50 0x7fd7e814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 -- 172.21.15.94:0/304269732 >> v1:172.21.15.94:6789/0 conn(0x7fd7e80b8480 legacy=0x7fd7e8144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1695d8700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa164144f40 0x7fa164156280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1695d8700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1640af710 con 0x7fa1640b8480 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1695d8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1640b8860 con 0x7fa1640ae9f0 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1695d8700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1640b0fe0 con 0x7fa164144f40 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa162ffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa1640b8480 0x7fa1640af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56778/0 (socket says 172.21.15.94:56778) 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa162ffd700 1 -- 172.21.15.94:0/3588075957 learned_addr learned my addr 172.21.15.94:0/3588075957 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1637fe700 1 --2- 172.21.15.94:0/3588075957 >> v2:172.21.15.94:3300/0 conn(0x7fa164144f40 0x7fa164156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f6ce9a07700 1 -- 172.21.15.94:0/3679564757 shutdown_connections 2024-03-18T18:09:21.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f6ce9a07700 1 -- 172.21.15.94:0/3679564757 wait complete. 2024-03-18T18:09:21.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7fbfa8001690 con 0x7fbfb0156200 2024-03-18T18:09:21.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1637fe700 1 -- 172.21.15.94:0/3588075957 >> v1:172.21.15.151:6789/0 conn(0x7fa1640ae9f0 legacy=0x7fa164144830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T18:09:21.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 Processor -- start 2024-03-18T18:09:21.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1637fe700 1 -- 172.21.15.94:0/3588075957 >> v1:172.21.15.94:6789/0 conn(0x7fa1640b8480 legacy=0x7fa1640af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1637fe700 1 -- 172.21.15.94:0/3588075957 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640b43e0 con 0x7fa164144f40 2024-03-18T18:09:21.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 -- 172.21.15.94:0/304269732 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e806ed90 con 0x7fd7e8071960 2024-03-18T18:09:21.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa1637fe700 1 --2- 172.21.15.94:0/3588075957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa164144f40 0x7fa164156280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa154009850 tx=0x7fa154009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cdbdad2d8a59b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa161ffb700 1 -- 172.21.15.94:0/3588075957 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154004230 con 0x7fa164144f40 2024-03-18T18:09:21.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fa161ffb700 1 -- 172.21.15.94:0/3588075957 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154004390 con 0x7fa164144f40 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 >> v1:172.21.15.151:6789/0 conn(0x7fbfb0156200 legacy=0x7fbfb015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf98003a20 0x7fbf98003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf98004870 0x7fbf98004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbf9800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9800c2e0 con 0x7fbf98005350 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9800c450 con 0x7fbf98004870 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9800c610 con 0x7fbf98003a20 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaf7fe700 1 --2- 172.21.15.94:0/3154575504 >> v2:172.21.15.94:3300/0 conn(0x7fbfb0155830 0x7fbfb0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbf9800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaffff700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf98003a20 0x7fbf98003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 -- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf98003a20 msgr2=0x7fbf98003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf98003a20 0x7fbf98003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 -- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf98004870 msgr2=0x7fbf98004cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf98004870 0x7fbf98004cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 -- 172.21.15.94:0/3154575504 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0156630 con 0x7fbf98005350 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 -- 172.21.15.94:0/3154575504 reap_dead start 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb4b29700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbf9800ba30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800d770 tx=0x7fbf980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc74234267bece server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8016070 con 0x7fbf98005350 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa8011410 con 0x7fbf98005350 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfaeffd700 1 -- 172.21.15.94:0/3154575504 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80117e0 con 0x7fbf98005350 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 -- 172.21.15.94:0/3154575504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 msgr2=0x7fbf9800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbf9800ba30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800d770 tx=0x7fbf980058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 -- 172.21.15.94:0/3154575504 shutdown_connections 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 --2- 172.21.15.94:0/3154575504 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbf9800ba30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 -- 172.21.15.94:0/3154575504 >> 172.21.15.94:0/3154575504 conn(0x7fbfb006a330 msgr2=0x7fbfb006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 -- 172.21.15.94:0/3154575504 shutdown_connections 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fbfb532a700 1 -- 172.21.15.94:0/3154575504 wait complete. 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- start start 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87cc004db0 0x7f87e01455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0143fa0 0x7f87e0143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87e01462c0 0x7f87e01435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e014aca0 con 0x7f87e01462c0 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0146810 con 0x7f87e0143fa0 2024-03-18T18:09:21.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e852e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e014aef0 con 0x7f87cc004db0 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ed813700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e814cc50 0x7fd7e814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7ec811700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e8071960 0x7fd7e8071e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009850 tx=0x7fd7e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9d45d8de350047 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7dffff700 1 -- 172.21.15.94:0/304269732 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00019d0 con 0x7fd7e8071960 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7dffff700 1 -- 172.21.15.94:0/304269732 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4004030 con 0x7fd7e8071960 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7fd7dffff700 1 -- 172.21.15.94:0/304269732 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00019d0 con 0x7fd7e8071960 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519406a3c0 0x7f51941455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51940b47f0 0x7f51941dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f51941e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f51941e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f51941e30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35302/0 (socket says 172.21.15.94:35302) 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 -- 172.21.15.94:0/3797314034 learned_addr learned my addr 172.21.15.94:0/3797314034 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5194148270 con 0x7f5194153210 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5194147790 con 0x7f51940b47f0 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5194148690 con 0x7f519406a3c0 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f5192ffd700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519406a3c0 0x7f51941455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51927fc700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51940b47f0 0x7f51941dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 -- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519406a3c0 msgr2=0x7f51941455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f519406a3c0 0x7f51941455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 -- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51940b47f0 msgr2=0x7f51941dfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51940b47f0 0x7f51941dfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184009570 con 0x7f5194153210 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51927fc700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51940b47f0 0x7f51941dfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51937fe700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f51941e30c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5184014040 tx=0x7f5184004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184004510 con 0x7f5194153210 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e6acb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87e01462c0 0x7f87e01435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e62ca700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87cc004db0 0x7f87e01455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e6acb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87e01462c0 0x7f87e01435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35314/0 (socket says 172.21.15.94:35314) 2024-03-18T18:09:21.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f87e6acb700 1 -- 172.21.15.94:0/3001061026 learned_addr learned my addr 172.21.15.94:0/3001061026 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5184030070 con 0x7f5194153210 2024-03-18T18:09:21.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519414ee50 con 0x7f5194153210 2024-03-18T18:09:21.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.736+0000 7f6ce9a07700 1 Processor -- start 2024-03-18T18:09:21.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 -- start start 2024-03-18T18:09:21.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e6acb700 1 -- 172.21.15.94:0/3001061026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87cc004db0 msgr2=0x7f87e01455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e6acb700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87cc004db0 0x7f87e01455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e6acb700 1 -- 172.21.15.94:0/3001061026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0143fa0 msgr2=0x7f87e0143090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T18:09:21.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e6acb700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0143fa0 0x7f87e0143090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e6acb700 1 -- 172.21.15.94:0/3001061026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e014b1d0 con 0x7f87e01462c0 2024-03-18T18:09:21.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa161ffb700 1 -- 172.21.15.94:0/3588075957 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540036c0 con 0x7fa164144f40 2024-03-18T18:09:21.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e6acb700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87e01462c0 0x7f87e01435d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87dc007040 tx=0x7f87dc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce406cc80 0x7f6ce413a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce40b0310 0x7f6ce41e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce4142520 0x7f6ce413ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40ac6f0 con 0x7f6ce40b0310 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4146560 con 0x7f6ce4142520 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce9a07700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce413e3f0 con 0x7f6ce406cc80 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 -- 172.21.15.94:0/304269732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e8071960 msgr2=0x7fd7e8071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e8071960 0x7fd7e8071e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009850 tx=0x7fd7e4009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:21.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5194146790 con 0x7f5194153210 2024-03-18T18:09:21.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184003900 con 0x7f5194153210 2024-03-18T18:09:21.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 Processor -- start 2024-03-18T18:09:21.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 -- start start 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0070d0 con 0x7f87e01462c0 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc007230 con 0x7f87e01462c0 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0075e0 con 0x7f87e01462c0 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e01d6000 con 0x7f87e01462c0 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbfb00ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb00abe80 0x7fbfb0070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfb0089730 0x7fbfb0089be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb008a120 con 0x7fbf98005350 2024-03-18T18:09:21.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00add60 con 0x7fbfb00abe80 2024-03-18T18:09:21.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb532a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00ae040 con 0x7fbfb0089730 2024-03-18T18:09:21.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e01d64c0 con 0x7f87e01462c0 2024-03-18T18:09:21.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 -- 172.21.15.94:0/304269732 shutdown_connections 2024-03-18T18:09:21.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e814cc50 0x7fd7e814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 --2- 172.21.15.94:0/304269732 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e8071960 0x7fd7e8071e10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 -- 172.21.15.94:0/304269732 >> 172.21.15.94:0/304269732 conn(0x7fd7e806a780 msgr2=0x7fd7e80b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 -- 172.21.15.94:0/3588075957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa164144f40 msgr2=0x7fa164156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 --2- 172.21.15.94:0/3588075957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa164144f40 0x7fa164156280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa154009850 tx=0x7fa154009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:21.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce4142520 0x7f6ce413ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce4142520 0x7f6ce413ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57780/0 (socket says 172.21.15.94:57780) 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce37fe700 1 -- 172.21.15.94:0/2516850056 learned_addr learned my addr 172.21.15.94:0/2516850056 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce40b0310 0x7f6ce41e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce2ffd700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce406cc80 0x7f6ce413a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 -- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce406cc80 msgr2=0x7f6ce413a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 Processor -- start 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb00abe80 0x7fbfb0070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfb4b29700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfb0089730 0x7fbfb0089be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87c8000fc0 con 0x7f87e01462c0 2024-03-18T18:09:21.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 -- 172.21.15.94:0/304269732 shutdown_connections 2024-03-18T18:09:21.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce406cc80 0x7f6ce413a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 -- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce4142520 msgr2=0x7f6ce413ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce4142520 0x7f6ce413ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 -- 172.21.15.94:0/2516850056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009570 con 0x7f6ce40b0310 2024-03-18T18:09:21.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb00abe80 0x7fbfb0070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57788/0 (socket says 172.21.15.94:57788) 2024-03-18T18:09:21.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 -- 172.21.15.94:0/2602843549 learned_addr learned my addr 172.21.15.94:0/2602843549 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaffff700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbfb00ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 -- 172.21.15.94:0/2602843549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfb0089730 msgr2=0x7fbfb0089be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfb0089730 0x7fbfb0089be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 -- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 msgr2=0x7fbfb00ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce2ffd700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce406cc80 0x7f6ce413a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:21.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce37fe700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce4142520 0x7f6ce413ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:21.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f519414ecd0 con 0x7f5194153210 2024-03-18T18:09:21.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5184003a60 con 0x7f5194153210 2024-03-18T18:09:21.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbf98005350 0x7fbfb00ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 -- 172.21.15.94:0/3588075957 shutdown_connections 2024-03-18T18:09:21.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 --2- 172.21.15.94:0/3588075957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa164144f40 0x7fa164156280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 -- 172.21.15.94:0/3588075957 >> 172.21.15.94:0/3588075957 conn(0x7fa16406a780 msgr2=0x7fa1640b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fbfaf7fe700 1 -- 172.21.15.94:0/2602843549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00ae320 con 0x7fbfb00abe80 2024-03-18T18:09:21.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 -- 172.21.15.94:0/3588075957 shutdown_connections 2024-03-18T18:09:21.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f6ce27fc700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce40b0310 0x7f6ce41e3410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4016000 tx=0x7f6cd4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 -- start start 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3cd00b8480 0x7f3cd00af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3cd00ae9f0 0x7f3cd0144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd01451a0 con 0x7f3cd0144d70 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00b0fe0 con 0x7f3cd00b8480 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3cd4a21700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00b8860 con 0x7f3cd00ae9f0 2024-03-18T18:09:21.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87dc01d420 con 0x7f87e01462c0 2024-03-18T18:09:21.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fa1695d8700 1 -- 172.21.15.94:0/3588075957 wait complete. 2024-03-18T18:09:21.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3ccf59e700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3cd0144d70 0x7f3cd014df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56780/0 (socket says 172.21.15.94:56780) 2024-03-18T18:09:21.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f3ccf59e700 1 -- 172.21.15.94:0/2978447985 learned_addr learned my addr 172.21.15.94:0/2978447985 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:21.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3cced9d700 1 --2- 172.21.15.94:0/2978447985 >> v2:172.21.15.94:3300/0 conn(0x7f3cd00b8480 0x7f3cd00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfaf7fe700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb00abe80 0x7fbfb0070eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c7d0 tx=0x7fbfa000cae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 Processor -- start 2024-03-18T18:09:21.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4004510 con 0x7f6ce40b0310 2024-03-18T18:09:21.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd401f070 con 0x7f6ce40b0310 2024-03-18T18:09:21.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4003900 con 0x7f6ce40b0310 2024-03-18T18:09:21.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87d6ffd700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c4066780 0x7f87c4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87dc085630 con 0x7f87e01462c0 2024-03-18T18:09:21.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87d6ffd700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f87c406e9a0 0x7f87c4070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 --> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87c4071470 con 0x7f87c406e9a0 2024-03-18T18:09:21.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87dc0859a0 con 0x7f87e01462c0 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 -- start start 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7fd7ef276700 1 -- 172.21.15.94:0/304269732 wait complete. 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 Processor -- start 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f517b7fe700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f5180066780 0x7f5180068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.740+0000 7f5192ffd700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f5180066780 0x7f5180068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5184032070 con 0x7f5194153210 2024-03-18T18:09:21.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f517b7fe700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f518006e830 0x7f5180070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5180071300 con 0x7f518006e830 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f518409f3a0 con 0x7f5194153210 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f5192ffd700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f5180066780 0x7f5180068c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f518c009fd0 tx=0x7f518c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 Processor -- start 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 -- start start 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011800 con 0x7fbfb00abe80 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa00119a0 con 0x7fbfb00abe80 2024-03-18T18:09:21.784 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011d50 con 0x7fbfb00abe80 2024-03-18T18:09:21.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb00a97f0 con 0x7fbfb00abe80 2024-03-18T18:09:21.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb01e8a20 con 0x7fbfb00abe80 2024-03-18T18:09:21.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce413e640 con 0x7f6ce40b0310 2024-03-18T18:09:21.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87e5ac9700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f87c406e9a0 0x7f87c4070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87e62ca700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c4066780 0x7f87c4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 -- start start 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3ccdd9b700 1 -- 172.21.15.94:0/2978447985 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632927012 0 0) 0x7f3cc8001490 con 0x7f3cd0144d70 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3ccdd9b700 1 -- 172.21.15.94:0/2978447985 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb80035d0 con 0x7f3cd0144d70 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3cced9d700 1 -- 172.21.15.94:0/2978447985 >> v2:172.21.15.151:3300/0 conn(0x7f3cd00ae9f0 msgr2=0x7f3cd0144830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3cced9d700 1 --2- 172.21.15.94:0/2978447985 >> v2:172.21.15.151:3300/0 conn(0x7f3cd00ae9f0 0x7f3cd0144830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3cced9d700 1 -- 172.21.15.94:0/2978447985 >> v1:172.21.15.94:6789/0 conn(0x7f3cd0144d70 legacy=0x7f3cd014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3cced9d700 1 -- 172.21.15.94:0/2978447985 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00b43e0 con 0x7f3cd00b8480 2024-03-18T18:09:21.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1640ae9f0 0x7fa1641469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1640b8480 0x7fa16413e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e98038430 0x7f7e980d4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7e980d4a70 0x7f7e980ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980d0fc0 con 0x7f7e98036c50 2024-03-18T18:09:21.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa164144f40 0x7fa16413eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1641df840 con 0x7fa1640b8480 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164146020 con 0x7fa164144f40 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa164146300 con 0x7fa1640ae9f0 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980372b0 con 0x7f7e980d4a70 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea5f3d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980d4ea0 con 0x7f7e98038430 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1640b8480 0x7fa16413e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1640b8480 0x7fa16413e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35354/0 (socket says 172.21.15.94:35354) 2024-03-18T18:09:21.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 -- 172.21.15.94:0/2753978614 learned_addr learned my addr 172.21.15.94:0/2753978614 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87e5ac9700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f87c406e9a0 0x7f87c4070dc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87e62ca700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c4066780 0x7f87c4068c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009480 tx=0x7f87d0009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e8071960 0x7fd7e814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e80b8480 0x7fd7e8153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e814cc50 0x7fd7e81543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151120 con 0x7fd7e814cc50 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8138180 con 0x7fd7e8071960 2024-03-18T18:09:21.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ef276700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e81dffb0 con 0x7fd7e80b8480 2024-03-18T18:09:21.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfb00aded0 con 0x7fbfb00abe80 2024-03-18T18:09:21.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa162ffd700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1640ae9f0 0x7fa1641469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce4146920 con 0x7f6ce40b0310 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea573c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7e980d4a70 0x7f7e980ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7e9ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e98038430 0x7f7e980d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e80b8480 0x7fd7e8153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ed012700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e8071960 0x7fd7e814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e80b8480 0x7fd7e8153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52574/0 (socket says 172.21.15.94:52574) 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 -- 172.21.15.94:0/2419035309 learned_addr learned my addr 172.21.15.94:0/2419035309 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ed813700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e814cc50 0x7fd7e81543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3cced9d700 1 --2- 172.21.15.94:0/2978447985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00b8480 0x7f3cd00af000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3cd006ccf0 tx=0x7f3cc0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d20b27627140c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea573c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7e980d4a70 0x7f7e980ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35372/0 (socket says 172.21.15.94:35372) 2024-03-18T18:09:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f7ea573c700 1 -- 172.21.15.94:0/3134542665 learned_addr learned my addr 172.21.15.94:0/3134542665 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1637fe700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa164144f40 0x7fa16413eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ce40af990 con 0x7f6ce40b0310 2024-03-18T18:09:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 -- 172.21.15.94:0/2753978614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1640ae9f0 msgr2=0x7fa1641469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1640ae9f0 0x7fa1641469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 -- 172.21.15.94:0/2753978614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa164144f40 msgr2=0x7fa16413eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa164144f40 0x7fa16413eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 -- 172.21.15.94:0/2753978614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540094b0 con 0x7fa1640b8480 2024-03-18T18:09:21.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f51927fc700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f518006e830 0x7f5180070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== osd.3 v2:172.21.15.94:6809/26024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f87c4071470 con 0x7f87c406e9a0 2024-03-18T18:09:21.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3ccdd9b700 1 -- 172.21.15.94:0/2978447985 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0011830 con 0x7f3cd00b8480 2024-03-18T18:09:21.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3ccdd9b700 1 -- 172.21.15.94:0/2978447985 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0011990 con 0x7f3cd00b8480 2024-03-18T18:09:21.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7f3ccdd9b700 1 -- 172.21.15.94:0/2978447985 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0011d20 con 0x7f3cd00b8480 2024-03-18T18:09:21.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1627fc700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1640b8480 0x7fa16413e640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa15800b550 tx=0x7fa15800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 -- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e8071960 msgr2=0x7fd7e814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7e8071960 0x7fd7e814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 -- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e814cc50 msgr2=0x7fd7e81543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd7e814cc50 0x7fd7e81543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 -- 172.21.15.94:0/2419035309 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40094b0 con 0x7fd7e80b8480 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158011830 con 0x7fa1640b8480 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158011990 con 0x7fa1640b8480 2024-03-18T18:09:21.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa164147c70 con 0x7fa1640b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1641d49e0 con 0x7fa1640b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158011d20 con 0x7fa1640b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.744+0000 7fd7ec811700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e80b8480 0x7fd7e8153e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009eb0 tx=0x7fd7e4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00019d0 con 0x7fd7e80b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e401f070 con 0x7fd7e80b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4003d20 con 0x7fd7e80b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e8151600 con 0x7fd7e80b8480 2024-03-18T18:09:21.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e81e0500 con 0x7fd7e80b8480 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 -- 172.21.15.94:0/2978447985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00b8480 msgr2=0x7f3cd00af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 --2- 172.21.15.94:0/2978447985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00b8480 0x7f3cd00af000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3cd006ccf0 tx=0x7f3cc0009b30 comp rx=0 tx=0).stop 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 -- 172.21.15.94:0/2978447985 shutdown_connections 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 --2- 172.21.15.94:0/2978447985 >> v2:172.21.15.151:3300/0 conn(0x7f3cd00ae9f0 0x7f3cd0144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 --2- 172.21.15.94:0/2978447985 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00b8480 0x7f3cd00af000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 -- 172.21.15.94:0/2978447985 >> 172.21.15.94:0/2978447985 conn(0x7f3cd006a780 msgr2=0x7f3cd00b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f7ea573c700 1 -- 172.21.15.94:0/3134542665 >> v2:172.21.15.151:3300/0 conn(0x7f7e98038430 msgr2=0x7f7e980d4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f7ea573c700 1 --2- 172.21.15.94:0/3134542665 >> v2:172.21.15.151:3300/0 conn(0x7f7e98038430 0x7f7e980d4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f7ea573c700 1 -- 172.21.15.94:0/3134542665 >> v1:172.21.15.151:6789/0 conn(0x7f7e98036c50 legacy=0x7f7e980d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:21.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f7ea573c700 1 -- 172.21.15.94:0/3134542665 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98029cc0 con 0x7f7e980d4a70 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f51927fc700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f518006e830 0x7f5180070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbfa0024480 con 0x7fbfb00abe80 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbf9c066760 0x7fbf9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfaffff700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbf9c066760 0x7fbf9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfa0084420 con 0x7fbfb00abe80 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fbf9c06e900 0x7fbf9c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 --> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf9c0713d0 con 0x7fbf9c06e900 2024-03-18T18:09:21.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfa0084870 con 0x7fbfb00abe80 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6cd4003a60 con 0x7f6ce40b0310 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6cd00667b0 0x7f6cd0068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd4021070 con 0x7f6ce40b0310 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f6cd006e9d0 0x7f6cd0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 --> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cd00714a0 con 0x7f6cd006e9d0 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cd4085bb0 con 0x7f6ce40b0310 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ce2ffd700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6cd00667b0 0x7f6cd0068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ce37fe700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f6cd006e9d0 0x7f6cd0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7e81445b0 con 0x7fd7e80b8480 2024-03-18T18:09:21.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 -- 172.21.15.94:0/2978447985 shutdown_connections 2024-03-18T18:09:21.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 -- 172.21.15.94:0/2978447985 wait complete. 2024-03-18T18:09:21.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f7ea573c700 1 --2- 172.21.15.94:0/3134542665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980ca840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7e980380b0 tx=0x7f7e8c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893845e3f60a3834 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfb4b29700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fbf9c06e900 0x7fbf9c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfb4b29700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fbf9c06e900 0x7fbf9c070d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ce37fe700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f6cd006e9d0 0x7f6cd0070df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ce2ffd700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6cd00667b0 0x7f6cd0068c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8006fd0 tx=0x7f6cd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa15801a400 con 0x7fa1640b8480 2024-03-18T18:09:21.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fa14b7fe700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa150066800 0x7fa150068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa158084110 con 0x7fa1640b8480 2024-03-18T18:09:21.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fa162ffd700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa150066800 0x7fa150068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfaffff700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbf9c066760 0x7fbf9c068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4000fb0 tx=0x7fbfa4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 Processor -- start 2024-03-18T18:09:21.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd7e4021030 con 0x7fd7e80b8480 2024-03-18T18:09:21.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== osd.5 v2:172.21.15.151:6808/26217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f5180071300 con 0x7f518006e830 2024-03-18T18:09:21.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fa162ffd700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa150066800 0x7fa150068cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa15c005cb0 tx=0x7fa15c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== osd.2 v2:172.21.15.94:6824/26033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6cd00714a0 con 0x7f6cd006e9d0 2024-03-18T18:09:21.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== osd.1 v2:172.21.15.94:6808/26023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fbf9c0713d0 con 0x7fbf9c06e900 2024-03-18T18:09:21.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7f3cd4a21700 1 -- start start 2024-03-18T18:09:21.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.748+0000 7fd7ddffb700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd7cc066800 0x7fd7cc068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7e40853e0 con 0x7fd7e80b8480 2024-03-18T18:09:21.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7e9f7fe700 1 -- 172.21.15.94:0/3134542665 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c004230 con 0x7f7e980d4a70 2024-03-18T18:09:21.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7e9f7fe700 1 -- 172.21.15.94:0/3134542665 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c004390 con 0x7f7e980d4a70 2024-03-18T18:09:21.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7e9f7fe700 1 -- 172.21.15.94:0/3134542665 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0036c0 con 0x7f7e980d4a70 2024-03-18T18:09:21.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ddffb700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd7cc06ea20 0x7fd7cc070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 --> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7cc0714f0 con 0x7fd7cc06ea20 2024-03-18T18:09:21.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e4085790 con 0x7fd7e80b8480 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cd4a21700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00ae9f0 0x7f3cd0146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ed012700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd7cc066800 0x7fd7cc068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cd4a21700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd00b8480 0x7f3cd01354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cd4a21700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd0144d70 0x7f3cd0070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cd4a21700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0135a10 con 0x7f3cd00ae9f0 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cd4a21700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01434d0 con 0x7f3cd00b8480 2024-03-18T18:09:21.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cd4a21700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00a9770 con 0x7f3cd0144d70 2024-03-18T18:09:21.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ed813700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd7cc06ea20 0x7fd7cc070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3ccf59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd0144d70 0x7f3cd0070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd00b8480 0x7f3cd01354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd00b8480 0x7f3cd01354d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57836/0 (socket says 172.21.15.94:57836) 2024-03-18T18:09:21.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 -- 172.21.15.94:0/3880401013 learned_addr learned my addr 172.21.15.94:0/3880401013 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ed012700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd7cc066800 0x7fd7cc068cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0002230 tx=0x7fd7e0001ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/3134542665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 msgr2=0x7f7e980ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/3134542665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980ca840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7e980380b0 tx=0x7f7e8c009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ed813700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd7cc06ea20 0x7fd7cc070e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 -- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd0144d70 msgr2=0x7f3cd0070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd0144d70 0x7f3cd0070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 -- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00ae9f0 msgr2=0x7f3cd0146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3cd00ae9f0 0x7f3cd0146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 -- 172.21.15.94:0/3880401013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00094b0 con 0x7f3cd00b8480 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fa1695d8700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fa1440015e0 0x7fa144003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.809 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 --> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa144006bf0 con 0x7fa1440015e0 2024-03-18T18:09:21.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/3134542665 shutdown_connections 2024-03-18T18:09:21.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/3134542665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980ca840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/3134542665 >> v2:172.21.15.151:3300/0 conn(0x7f7e98038430 0x7f7e980d4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/3134542665 >> 172.21.15.94:0/3134542665 conn(0x7f7e9803aca0 msgr2=0x7f7e98005f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/3134542665 shutdown_connections 2024-03-18T18:09:21.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cce59c700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd00b8480 0x7f3cd01354d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400b550 tx=0x7f3cc400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fa1637fe700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fa1440015e0 0x7fa144003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fa1637fe700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fa1440015e0 0x7fa144003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== osd.4 v2:172.21.15.151:6822/26215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd7cc0714f0 con 0x7fd7cc06ea20 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4011830 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40119b0 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.752+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4011d60 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.756+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd0147310 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.756+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd0070cc0 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.756+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3cd00b1ef0 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3cc401a400 con 0x7f3cd00b8480 2024-03-18T18:09:21.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== osd.0 v2:172.21.15.94:6800/26022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fa144006bf0 con 0x7fa1440015e0 2024-03-18T18:09:21.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f3cb77fe700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f3cbc066730 0x7f3cbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cc4084790 con 0x7f3cd00b8480 2024-03-18T18:09:21.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f3cb77fe700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7f3cbc06e760 0x7f3cbc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 --> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cbc071230 con 0x7f3cbc06e760 2024-03-18T18:09:21.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cc4084be0 con 0x7f3cd00b8480 2024-03-18T18:09:21.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.760+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/3134542665 wait complete. 2024-03-18T18:09:21.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f3ccf59e700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7f3cbc06e760 0x7f3cbc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f3cced9d700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f3cbc066730 0x7f3cbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f3ccf59e700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7f3cbc06e760 0x7f3cbc070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f7ea5f3d700 1 Processor -- start 2024-03-18T18:09:21.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f3cced9d700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f3cbc066730 0x7f3cbc068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009b70 tx=0x7f3cc0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 --> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87c8002d60 con 0x7f87c406e9a0 2024-03-18T18:09:21.815 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f87d6ffd700 1 -- 172.21.15.94:0/3001061026 <== osd.3 v2:172.21.15.94:6809/26024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f87c8002d60 con 0x7f87c406e9a0 2024-03-18T18:09:21.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.764+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== osd.6 v2:172.21.15.151:6816/26216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3cbc071230 con 0x7f3cbc06e760 2024-03-18T18:09:21.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 --> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbfb0072290 con 0x7fbf9c06e900 2024-03-18T18:09:21.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f87c406e9a0 msgr2=0x7f87c4070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f87c406e9a0 0x7f87c4070dc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 -- start start 2024-03-18T18:09:21.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 --> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ce40aeb70 con 0x7f6cd006e9d0 2024-03-18T18:09:21.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c4066780 msgr2=0x7f87c4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c4066780 0x7f87c4068c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009480 tx=0x7f87d0009240 comp rx=0 tx=0).stop 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87e01462c0 msgr2=0x7f87e01435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 --2- 172.21.15.94:0/3001061026 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87e01462c0 0x7f87e01435d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87dc007040 tx=0x7f87dc000fe0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e6acb700 1 -- 172.21.15.94:0/3001061026 reap_dead start 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 shutdown_connections 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 >> 172.21.15.94:0/3001061026 conn(0x7f87e006a780 msgr2=0x7f87e00b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 shutdown_connections 2024-03-18T18:09:21.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f87e852e700 1 -- 172.21.15.94:0/3001061026 wait complete. 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e98036c50 0x7f7e980d3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e98038430 0x7f7e980c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980d3b40 con 0x7f7e980d4a70 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c2570 con 0x7f7e98036c50 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c1590 con 0x7f7e98038430 2024-03-18T18:09:21.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f6ccbfff700 1 -- 172.21.15.94:0/2516850056 <== osd.2 v2:172.21.15.94:6824/26033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6cdc00d2d0 con 0x7f6cd006e9d0 2024-03-18T18:09:21.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea573c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea4f3b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e98036c50 0x7f7e980d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea4f3b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e98036c50 0x7f7e980d3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57838/0 (socket says 172.21.15.94:57838) 2024-03-18T18:09:21.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea4f3b700 1 -- 172.21.15.94:0/1643576365 learned_addr learned my addr 172.21.15.94:0/1643576365 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:21.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e98038430 0x7f7e980c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7fbfacff9700 1 -- 172.21.15.94:0/2602843549 <== osd.1 v2:172.21.15.94:6808/26023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbfa8001450 con 0x7fbf9c06e900 2024-03-18T18:09:21.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 -- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e98036c50 msgr2=0x7f7e980d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e98036c50 0x7f7e980d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 -- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 msgr2=0x7f7e980c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 -- 172.21.15.94:0/1643576365 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009570 con 0x7f7e98038430 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fbf9c06e900 msgr2=0x7fbf9c070d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fbf9c06e900 0x7fbf9c070d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbf9c066760 msgr2=0x7fbf9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbf9c066760 0x7fbf9c068c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4000fb0 tx=0x7fbfa4009040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb00abe80 msgr2=0x7fbfb0070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 --2- 172.21.15.94:0/2602843549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb00abe80 0x7fbfb0070eb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c7d0 tx=0x7fbfa000cae0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb4b29700 1 -- 172.21.15.94:0/2602843549 reap_dead start 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 shutdown_connections 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 >> 172.21.15.94:0/2602843549 conn(0x7fbfb006a330 msgr2=0x7fbfb006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 shutdown_connections 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7fbfb532a700 1 -- 172.21.15.94:0/2602843549 wait complete. 2024-03-18T18:09:21.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f6cd006e9d0 msgr2=0x7f6cd0070df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f6cd006e9d0 0x7f6cd0070df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6cd00667b0 msgr2=0x7f6cd0068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6cd00667b0 0x7f6cd0068c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8006fd0 tx=0x7f6cd8008040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce40b0310 msgr2=0x7f6ce41e3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 --2- 172.21.15.94:0/2516850056 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ce40b0310 0x7f6ce41e3410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4016000 tx=0x7f6cd4004770 comp rx=0 tx=0).stop 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce37fe700 1 -- 172.21.15.94:0/2516850056 reap_dead start 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 shutdown_connections 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 >> 172.21.15.94:0/2516850056 conn(0x7f6ce406a780 msgr2=0x7f6ce40b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 shutdown_connections 2024-03-18T18:09:21.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f6ce9a07700 1 -- 172.21.15.94:0/2516850056 wait complete. 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea573c700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e980d4a70 0x7f7e980c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea4f3b700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e98036c50 0x7f7e980d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9ffff700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e98038430 0x7f7e980c2030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7ea004fd90 tx=0x7f7ea00673e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0066150 con 0x7f7e98038430 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c1870 con 0x7f7e98038430 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0072070 con 0x7f7e98038430 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea006b850 con 0x7f7e98038430 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.772+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c5f10 con 0x7f7e98038430 2024-03-18T18:09:21.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7ea006b9b0 con 0x7f7e98038430 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f7e9d7fa700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7e84066730 0x7f7e84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f7ea4f3b700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7e84066730 0x7f7e84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ea00fd920 con 0x7f7e98038430 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.776+0000 7f7ea4f3b700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7e84066730 0x7f7e84068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e980d0530 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f7e980d0630 0x7f7e980c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 --> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e980d0c50 con 0x7f7e980d0630 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f7ea573c700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f7e980d0630 0x7f7e980c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 --> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51940b1080 con 0x7f518006e830 2024-03-18T18:09:21.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 --> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7e806efd0 con 0x7fd7cc06ea20 2024-03-18T18:09:21.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f7ea573c700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f7e980d0630 0x7f7e980c96a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:21.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ddffb700 1 -- 172.21.15.94:0/2419035309 <== osd.4 v2:172.21.15.151:6822/26215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7d800c040 con 0x7fd7cc06ea20 2024-03-18T18:09:21.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f517b7fe700 1 -- 172.21.15.94:0/3797314034 <== osd.5 v2:172.21.15.151:6808/26217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5188001470 con 0x7f518006e830 2024-03-18T18:09:21.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd7cc06ea20 msgr2=0x7fd7cc070e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd7cc06ea20 0x7fd7cc070e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd7cc066800 msgr2=0x7fd7cc068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd7cc066800 0x7fd7cc068cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0002230 tx=0x7fd7e0001ec0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e80b8480 msgr2=0x7fd7e8153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 --2- 172.21.15.94:0/2419035309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7e80b8480 0x7fd7e8153e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009eb0 tx=0x7fd7e4004770 comp rx=0 tx=0).stop 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ed813700 1 -- 172.21.15.94:0/2419035309 reap_dead start 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 shutdown_connections 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 >> 172.21.15.94:0/2419035309 conn(0x7fd7e806a780 msgr2=0x7fd7e80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f518006e830 msgr2=0x7f5180070c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f518006e830 0x7f5180070c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 shutdown_connections 2024-03-18T18:09:21.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7fd7ef276700 1 -- 172.21.15.94:0/2419035309 wait complete. 2024-03-18T18:09:21.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f5180066780 msgr2=0x7f5180068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f5180066780 0x7f5180068c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f518c009fd0 tx=0x7f518c00b040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 msgr2=0x7f51941e30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 --2- 172.21.15.94:0/3797314034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5194153210 0x7f51941e30c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5184014040 tx=0x7f5184004770 comp rx=0 tx=0).stop 2024-03-18T18:09:21.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51937fe700 1 -- 172.21.15.94:0/3797314034 reap_dead start 2024-03-18T18:09:21.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== osd.7 v2:172.21.15.151:6800/26214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f7e8c004030 con 0x7f7e980d0630 2024-03-18T18:09:21.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 shutdown_connections 2024-03-18T18:09:21.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 >> 172.21.15.94:0/3797314034 conn(0x7f51940b8ba0 msgr2=0x7f51941445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 shutdown_connections 2024-03-18T18:09:21.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.780+0000 7f51992b1700 1 -- 172.21.15.94:0/3797314034 wait complete. 2024-03-18T18:09:21.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.784+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 --> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa144005c70 con 0x7fa1440015e0 2024-03-18T18:09:21.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.784+0000 7fa14b7fe700 1 -- 172.21.15.94:0/2753978614 <== osd.0 v2:172.21.15.94:6800/26022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa144005c70 con 0x7fa1440015e0 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fa1440015e0 msgr2=0x7fa144003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fa1440015e0 0x7fa144003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa150066800 msgr2=0x7fa150068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa150066800 0x7fa150068cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa15c005cb0 tx=0x7fa15c009040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1640b8480 msgr2=0x7fa16413e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 --2- 172.21.15.94:0/2753978614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa1640b8480 0x7fa16413e640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa15800b550 tx=0x7fa15800b910 comp rx=0 tx=0).stop 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1637fe700 1 -- 172.21.15.94:0/2753978614 reap_dead start 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 shutdown_connections 2024-03-18T18:09:21.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 >> 172.21.15.94:0/2753978614 conn(0x7fa16406a780 msgr2=0x7fa1640b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 shutdown_connections 2024-03-18T18:09:21.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7fa1695d8700 1 -- 172.21.15.94:0/2753978614 wait complete. 2024-03-18T18:09:21.833 INFO:teuthology.orchestra.run.smithi094.stdout:60129542151 2024-03-18T18:09:21.834 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T18:09:21.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 --> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3cd00b0290 con 0x7f3cbc06e760 2024-03-18T18:09:21.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.788+0000 7f3cb77fe700 1 -- 172.21.15.94:0/3880401013 <== osd.6 v2:172.21.15.151:6816/26216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3cc8001f30 con 0x7f3cbc06e760 2024-03-18T18:09:21.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7f3cbc06e760 msgr2=0x7f3cbc070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7f3cbc06e760 0x7f3cbc070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f3cbc066730 msgr2=0x7f3cbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f3cbc066730 0x7f3cbc068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009b70 tx=0x7f3cc0010000 comp rx=0 tx=0).stop 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd00b8480 msgr2=0x7f3cd01354d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 --2- 172.21.15.94:0/3880401013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd00b8480 0x7f3cd01354d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400b550 tx=0x7f3cc400b860 comp rx=0 tx=0).stop 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3ccf59e700 1 -- 172.21.15.94:0/3880401013 reap_dead start 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 shutdown_connections 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 >> 172.21.15.94:0/3880401013 conn(0x7f3cd006a780 msgr2=0x7f3cd014aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 shutdown_connections 2024-03-18T18:09:21.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.792+0000 7f3cd4a21700 1 -- 172.21.15.94:0/3880401013 wait complete. 2024-03-18T18:09:21.837 INFO:teuthology.orchestra.run.smithi094.stdout:64424509447 2024-03-18T18:09:21.837 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T18:09:21.838 INFO:teuthology.orchestra.run.smithi094.stdout:68719476744 2024-03-18T18:09:21.838 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-18T18:09:21.839 INFO:teuthology.orchestra.run.smithi094.stdout:68719476742 2024-03-18T18:09:21.839 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-18T18:09:21.840 INFO:teuthology.orchestra.run.smithi094.stdout:64424509447 2024-03-18T18:09:21.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T18:09:21.841 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-03-18T18:09:21.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T18:09:21.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 --> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e980c13f0 con 0x7f7e980d0630 2024-03-18T18:09:21.843 INFO:teuthology.orchestra.run.smithi094.stdout:68719476744 2024-03-18T18:09:21.843 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-18T18:09:21.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7e9d7fa700 1 -- 172.21.15.94:0/1643576365 <== osd.7 v2:172.21.15.151:6800/26214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e980c13f0 con 0x7f7e980d0630 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f7e980d0630 msgr2=0x7f7e980c96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f7e980d0630 0x7f7e980c96a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7e84066730 msgr2=0x7f7e84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7e84066730 0x7f7e84068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7e980d0530 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e98038430 msgr2=0x7f7e980c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 --2- 172.21.15.94:0/1643576365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e98038430 0x7f7e980c2030 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7ea004fd90 tx=0x7f7ea00673e0 comp rx=0 tx=0).stop 2024-03-18T18:09:21.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea573c700 1 -- 172.21.15.94:0/1643576365 reap_dead start 2024-03-18T18:09:21.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 shutdown_connections 2024-03-18T18:09:21.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 >> 172.21.15.94:0/1643576365 conn(0x7f7e9803aca0 msgr2=0x7f7e980049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:21.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 shutdown_connections 2024-03-18T18:09:21.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:21.808+0000 7f7ea5f3d700 1 -- 172.21.15.94:0/1643576365 wait complete. 2024-03-18T18:09:21.846 INFO:teuthology.orchestra.run.smithi094.stdout:68719476744 2024-03-18T18:09:21.847 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-18T18:09:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7f0623fff700 1 Processor -- start 2024-03-18T18:09:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7f0623fff700 1 -- start start 2024-03-18T18:09:22.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7f407b4ff700 1 Processor -- start 2024-03-18T18:09:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7f407b4ff700 1 -- start start 2024-03-18T18:09:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7f0484ae0700 1 Processor -- start 2024-03-18T18:09:22.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7fc49f59e700 1 Processor -- start 2024-03-18T18:09:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7fc49f59e700 1 -- start start 2024-03-18T18:09:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.028+0000 7f0484ae0700 1 -- start start 2024-03-18T18:09:22.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407b4ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40740ad120 0x7f4074146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407b4ff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40740b5480 con 0x7f40740b50a0 2024-03-18T18:09:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407b4ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40740af320 con 0x7f40740adfd0 2024-03-18T18:09:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407b4ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740b16d0 con 0x7f40740ad120 2024-03-18T18:09:22.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06240b4f00 0x7f06240aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49f59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc4a00aea70 0x7fc4a00b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49f59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4a0146290 0x7fc4a0146720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49f59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00b0b00 con 0x7fc4a013fd30 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49f59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00b0540 con 0x7fc4a0146290 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49f59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00b1f70 con 0x7fc4a00aea70 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f04800afe10 0x7f0480142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04800af200 con 0x7f04800b0d60 2024-03-18T18:09:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04800b1f40 con 0x7f04800b0980 2024-03-18T18:09:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0480143470 con 0x7f04800afe10 2024-03-18T18:09:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407929b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f40740b50a0 0x7f40740b26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56784/0 (socket says 172.21.15.94:56784) 2024-03-18T18:09:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407929b700 1 -- 172.21.15.94:0/1426924451 learned_addr learned my addr 172.21.15.94:0/1426924451 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:22.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f4078a9a700 1 --2- 172.21.15.94:0/1426924451 >> v2:172.21.15.151:3300/0 conn(0x7f40740ad120 0x7f4074146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047effd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f04800b0d60 0x7f04800af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56800/0 (socket says 172.21.15.94:56800) 2024-03-18T18:09:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047effd700 1 -- 172.21.15.94:0/2626916431 learned_addr learned my addr 172.21.15.94:0/2626916431 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49ed9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4a0146290 0x7fc4a0146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047ffff700 1 --2- 172.21.15.94:0/2626916431 >> v2:172.21.15.94:3300/0 conn(0x7f04800afe10 0x7f0480142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06240b4f00 0x7f06240aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06240b4f00 0x7f06240aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35430/0 (socket says 172.21.15.94:35430) 2024-03-18T18:09:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 -- 172.21.15.94:0/572174807 learned_addr learned my addr 172.21.15.94:0/572174807 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49dd9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc4a013fd30 0x7fc4a0140190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:49282/0 (socket says 172.21.15.94:49282) 2024-03-18T18:09:22.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49dd9b700 1 -- 172.21.15.94:0/4008756031 learned_addr learned my addr 172.21.15.94:0/4008756031 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:22.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047ffff700 1 -- 172.21.15.94:0/2626916431 >> v1:172.21.15.151:6789/0 conn(0x7f04800b0980 legacy=0x7f048013c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047ffff700 1 -- 172.21.15.94:0/2626916431 >> v1:172.21.15.94:6789/0 conn(0x7f04800b0d60 legacy=0x7f04800af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047ffff700 1 -- 172.21.15.94:0/2626916431 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480143750 con 0x7f04800afe10 2024-03-18T18:09:22.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 --2- 172.21.15.94:0/572174807 >> v2:172.21.15.151:3300/0 conn(0x7f062414a7a0 0x7f0624151140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240b34f0 con 0x7f0624149c00 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06240ae050 con 0x7f06240b4f00 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06240b52e0 con 0x7f062414a7a0 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f4078a9a700 1 -- 172.21.15.94:0/1426924451 >> v1:172.21.15.151:6789/0 conn(0x7f40740adfd0 legacy=0x7f4074147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f4078a9a700 1 -- 172.21.15.94:0/1426924451 >> v1:172.21.15.94:6789/0 conn(0x7f40740b50a0 legacy=0x7f40740b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f4078a9a700 1 -- 172.21.15.94:0/1426924451 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740b41a0 con 0x7f40740ad120 2024-03-18T18:09:22.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f406bfff700 1 -- 172.21.15.94:0/1426924451 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108946244 0 0) 0x7f40740b5480 con 0x7f40740b50a0 2024-03-18T18:09:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047ffff700 1 --2- 172.21.15.94:0/2626916431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f0480142e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0470009850 tx=0x7f0470009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53be18347b8a42 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f06237fe700 1 --2- 172.21.15.94:0/572174807 >> v2:172.21.15.151:3300/0 conn(0x7f062414a7a0 0x7f0624151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 -- 172.21.15.94:0/572174807 >> v2:172.21.15.151:3300/0 conn(0x7f062414a7a0 msgr2=0x7f0624151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 --2- 172.21.15.94:0/572174807 >> v2:172.21.15.151:3300/0 conn(0x7f062414a7a0 0x7f0624151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 -- 172.21.15.94:0/572174807 >> v1:172.21.15.151:6789/0 conn(0x7f0624149c00 legacy=0x7f062414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f4078a9a700 1 --2- 172.21.15.94:0/1426924451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740ad120 0x7f4074146af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4064009850 tx=0x7f4064009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68199b2631ccfe02 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 -- 172.21.15.94:0/572174807 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240af0a0 con 0x7f06240b4f00 2024-03-18T18:09:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49e59c700 1 --2- 172.21.15.94:0/4008756031 >> v2:172.21.15.151:3300/0 conn(0x7fc4a00aea70 0x7fc4a00b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49ed9d700 1 -- 172.21.15.94:0/4008756031 >> v2:172.21.15.151:3300/0 conn(0x7fc4a00aea70 msgr2=0x7fc4a00b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49ed9d700 1 --2- 172.21.15.94:0/4008756031 >> v2:172.21.15.151:3300/0 conn(0x7fc4a00aea70 0x7fc4a00b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49ed9d700 1 -- 172.21.15.94:0/4008756031 >> v1:172.21.15.151:6789/0 conn(0x7fc4a013fd30 legacy=0x7fc4a0140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49ed9d700 1 -- 172.21.15.94:0/4008756031 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00b4360 con 0x7fc4a0146290 2024-03-18T18:09:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0622ffd700 1 --2- 172.21.15.94:0/572174807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240aca90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06240ae2f0 tx=0x7f0618009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42336aff72ee35 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49ed9d700 1 --2- 172.21.15.94:0/4008756031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a0146290 0x7fc4a0146720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00b5550 tx=0x7fc49800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7f0f0fab71018a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f406bfff700 1 -- 172.21.15.94:0/1426924451 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011830 con 0x7f40740ad120 2024-03-18T18:09:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f406bfff700 1 -- 172.21.15.94:0/1426924451 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064011990 con 0x7f40740ad120 2024-03-18T18:09:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f406bfff700 1 -- 172.21.15.94:0/1426924451 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064011d20 con 0x7f40740ad120 2024-03-18T18:09:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0621ffb700 1 -- 172.21.15.94:0/572174807 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011830 con 0x7f06240b4f00 2024-03-18T18:09:22.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047e7fc700 1 -- 172.21.15.94:0/2626916431 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011830 con 0x7f04800afe10 2024-03-18T18:09:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0621ffb700 1 -- 172.21.15.94:0/572174807 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618011990 con 0x7f06240b4f00 2024-03-18T18:09:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0621ffb700 1 -- 172.21.15.94:0/572174807 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011d20 con 0x7f06240b4f00 2024-03-18T18:09:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047e7fc700 1 -- 172.21.15.94:0/2626916431 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0470011990 con 0x7f04800afe10 2024-03-18T18:09:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f047e7fc700 1 -- 172.21.15.94:0/2626916431 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470011d20 con 0x7f04800afe10 2024-03-18T18:09:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- 172.21.15.94:0/2626916431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 msgr2=0x7f0480142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 --2- 172.21.15.94:0/2626916431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f0480142e90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0470009850 tx=0x7f0470009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f63451dd700 1 Processor -- start 2024-03-18T18:09:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49d59a700 1 -- 172.21.15.94:0/4008756031 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49800bd90 con 0x7fc4a0146290 2024-03-18T18:09:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f63451dd700 1 -- start start 2024-03-18T18:09:22.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49d59a700 1 -- 172.21.15.94:0/4008756031 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4980104d0 con 0x7fc4a0146290 2024-03-18T18:09:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fc49d59a700 1 -- 172.21.15.94:0/4008756031 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498010880 con 0x7fc4a0146290 2024-03-18T18:09:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- 172.21.15.94:0/2626916431 shutdown_connections 2024-03-18T18:09:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 --2- 172.21.15.94:0/2626916431 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f0480142e90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- 172.21.15.94:0/2626916431 >> 172.21.15.94:0/2626916431 conn(0x7f048006a780 msgr2=0x7f04800b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fbc0960c700 1 Processor -- start 2024-03-18T18:09:22.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fbc0960c700 1 -- start start 2024-03-18T18:09:22.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fbc0960c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc040afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407b4ff700 1 -- 172.21.15.94:0/1426924451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740ad120 msgr2=0x7f4074146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fbc0960c700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc040af550 con 0x7fbc04144e40 2024-03-18T18:09:22.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fbc0960c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc040b5280 con 0x7fbc040b1e10 2024-03-18T18:09:22.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7fbc0960c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040b0d30 con 0x7fbc040b4ea0 2024-03-18T18:09:22.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f407b4ff700 1 --2- 172.21.15.94:0/1426924451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740ad120 0x7f4074146af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4064009850 tx=0x7f4064009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:22.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 msgr2=0x7f06240aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0623fff700 1 --2- 172.21.15.94:0/572174807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240aca90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06240ae2f0 tx=0x7f0618009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.032+0000 7f0484ae0700 1 -- 172.21.15.94:0/2626916431 shutdown_connections 2024-03-18T18:09:22.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 -- 172.21.15.94:0/2626916431 wait complete. 2024-03-18T18:09:22.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc02ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc040afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 shutdown_connections 2024-03-18T18:09:22.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 --2- 172.21.15.94:0/572174807 >> v2:172.21.15.151:3300/0 conn(0x7f062414a7a0 0x7f0624151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 --2- 172.21.15.94:0/572174807 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240aca90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 >> 172.21.15.94:0/572174807 conn(0x7f062406a330 msgr2=0x7f062406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f407b4ff700 1 -- 172.21.15.94:0/1426924451 shutdown_connections 2024-03-18T18:09:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f407b4ff700 1 --2- 172.21.15.94:0/1426924451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740ad120 0x7f4074146af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f407b4ff700 1 -- 172.21.15.94:0/1426924451 >> 172.21.15.94:0/1426924451 conn(0x7f407406a330 msgr2=0x7f407406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc027fc700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbc040b1e10 0x7fbc04144730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:49302/0 (socket says 172.21.15.94:49302) 2024-03-18T18:09:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc027fc700 1 -- 172.21.15.94:0/2740804089 learned_addr learned my addr 172.21.15.94:0/2740804089 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:22.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc02ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc040afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52610/0 (socket says 172.21.15.94:52610) 2024-03-18T18:09:22.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 shutdown_connections 2024-03-18T18:09:22.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- 172.21.15.94:0/572174807 wait complete. 2024-03-18T18:09:22.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc01ffb700 1 -- 172.21.15.94:0/2740804089 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172399278 0 0) 0x7fbc040b5280 con 0x7fbc040b1e10 2024-03-18T18:09:22.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc01ffb700 1 -- 172.21.15.94:0/2740804089 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbec0035d0 con 0x7fbc040b1e10 2024-03-18T18:09:22.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc02ffd700 1 -- 172.21.15.94:0/2740804089 >> v1:172.21.15.151:6789/0 conn(0x7fbc040b1e10 legacy=0x7fbc04144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc02ffd700 1 -- 172.21.15.94:0/2740804089 >> v1:172.21.15.94:6789/0 conn(0x7fbc04144e40 legacy=0x7fbc04155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc02ffd700 1 -- 172.21.15.94:0/2740804089 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040af1e0 con 0x7fbc040b4ea0 2024-03-18T18:09:22.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63400b4a50 0x7f63400afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6340144e40 0x7f63400b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63400af550 con 0x7f63400b1e10 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63400b0d30 con 0x7f63400b4a50 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63400af000 con 0x7f6340144e40 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63400b4a50 0x7f63400afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f63400b4a50 0x7f63400afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35432/0 (socket says 172.21.15.94:35432) 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 -- 172.21.15.94:0/1617107212 learned_addr learned my addr 172.21.15.94:0/1617107212 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc02ffd700 1 --2- 172.21.15.94:0/2740804089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc040afc10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009880 tx=0x7fbbf8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730abfa9c1312364 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63449dc700 1 --2- 172.21.15.94:0/1617107212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6340144e40 0x7f63400b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 -- 172.21.15.94:0/1617107212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6340144e40 msgr2=0x7f63400b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 --2- 172.21.15.94:0/1617107212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6340144e40 0x7f63400b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 -- 172.21.15.94:0/1617107212 >> v1:172.21.15.151:6789/0 conn(0x7f63400b1e10 legacy=0x7f6340144730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T18:09:22.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 -- 172.21.15.94:0/1617107212 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400b4e30 con 0x7f63400b4a50 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 Processor -- start 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- 172.21.15.94:0/4008756031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a0146290 msgr2=0x7fc4a0146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 --2- 172.21.15.94:0/4008756031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a0146290 0x7fc4a0146720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00b5550 tx=0x7fc49800b330 comp rx=0 tx=0).stop 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- 172.21.15.94:0/4008756031 shutdown_connections 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 --2- 172.21.15.94:0/4008756031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a0146290 0x7fc4a0146720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 --2- 172.21.15.94:0/4008756031 >> v2:172.21.15.151:3300/0 conn(0x7fc4a00aea70 0x7fc4a00b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- 172.21.15.94:0/4008756031 >> 172.21.15.94:0/4008756031 conn(0x7fc4a006a330 msgr2=0x7fc4a006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- 172.21.15.94:0/4008756031 shutdown_connections 2024-03-18T18:09:22.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- 172.21.15.94:0/4008756031 wait complete. 2024-03-18T18:09:22.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 -- start start 2024-03-18T18:09:22.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633ffff700 1 --2- 172.21.15.94:0/1617107212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63400b4a50 0x7f63400afc10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6330009e80 tx=0x7f633000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c44152a02c2d54 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633effd700 1 -- 172.21.15.94:0/1617107212 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000e070 con 0x7f63400b4a50 2024-03-18T18:09:22.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633effd700 1 -- 172.21.15.94:0/1617107212 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330003a40 con 0x7f63400b4a50 2024-03-18T18:09:22.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f633effd700 1 -- 172.21.15.94:0/1617107212 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330003dd0 con 0x7f63400b4a50 2024-03-18T18:09:22.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 Processor -- start 2024-03-18T18:09:22.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f407b4ff700 1 -- 172.21.15.94:0/1426924451 shutdown_connections 2024-03-18T18:09:22.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- start start 2024-03-18T18:09:22.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 Processor -- start 2024-03-18T18:09:22.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f04801df820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04800b0980 0x7f04800a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04800b0d60 0x7f048013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0480071dc0 con 0x7f04800afe10 2024-03-18T18:09:22.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0480071b20 con 0x7f04800b0980 2024-03-18T18:09:22.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0484ae0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04801df340 con 0x7f04800b0d60 2024-03-18T18:09:22.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- start start 2024-03-18T18:09:22.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f422927f700 1 Processor -- start 2024-03-18T18:09:22.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f04801df820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f04801df820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35442/0 (socket says 172.21.15.94:35442) 2024-03-18T18:09:22.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 -- 172.21.15.94:0/339126127 learned_addr learned my addr 172.21.15.94:0/339126127 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047ffff700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04800b0d60 0x7f048013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 -- 172.21.15.94:0/1617107212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63400b4a50 msgr2=0x7f63400afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 --2- 172.21.15.94:0/1617107212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63400b4a50 0x7f63400afc10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6330009e80 tx=0x7f633000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:22.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047effd700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04800b0980 0x7f04800a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc01ffb700 1 -- 172.21.15.94:0/2740804089 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8004230 con 0x7fbc040b4ea0 2024-03-18T18:09:22.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 -- 172.21.15.94:0/1617107212 shutdown_connections 2024-03-18T18:09:22.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 --2- 172.21.15.94:0/1617107212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6340144e40 0x7f63400b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 --2- 172.21.15.94:0/1617107212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63400b4a50 0x7f63400afc10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f63451dd700 1 -- 172.21.15.94:0/1617107212 >> 172.21.15.94:0/1617107212 conn(0x7f634006a330 msgr2=0x7f634006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc01ffb700 1 -- 172.21.15.94:0/2740804089 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8004390 con 0x7fbc040b4ea0 2024-03-18T18:09:22.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc01ffb700 1 -- 172.21.15.94:0/2740804089 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80036c0 con 0x7fbc040b4ea0 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0624149c00 0x7f06240aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f062414a7a0 0x7f06241d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624071380 con 0x7f06240b4f00 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624147910 con 0x7f0624149c00 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0623fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06241e0cd0 con 0x7f062414a7a0 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 -- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04800b0d60 msgr2=0x7f048013f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04800b0d60 0x7f048013f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 -- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04800b0980 msgr2=0x7f04800a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04800b0980 0x7f04800a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 -- 172.21.15.94:0/339126127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04700094b0 con 0x7f04800afe10 2024-03-18T18:09:22.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 0x7fc4a01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0146290 0x7fc4a01e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a01e39b0 0x7fc4a006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0071480 con 0x7fc4a01e39b0 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01e3e60 con 0x7fc4a0146290 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0071690 con 0x7fc4a013fd30 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35458/0 (socket says 172.21.15.94:35458) 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 -- 172.21.15.94:0/1373338627 learned_addr learned my addr 172.21.15.94:0/1373338627 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f06227fc700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0624149c00 0x7f06240aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f047f7fe700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f04801df820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f047400c500 tx=0x7f047400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 -- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f062414a7a0 msgr2=0x7f06241d6bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T18:09:22.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f062414a7a0 0x7f06241d6bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 -- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0624149c00 msgr2=0x7f06240aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0624149c00 0x7f06240aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0622ffd700 1 -- 172.21.15.94:0/1373338627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009570 con 0x7f06240b4f00 2024-03-18T18:09:22.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc0960c700 1 -- 172.21.15.94:0/2740804089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 msgr2=0x7fbc040afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fbc0960c700 1 --2- 172.21.15.94:0/2740804089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc040afc10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009880 tx=0x7fbbf8009b90 comp rx=0 tx=0).stop 2024-03-18T18:09:22.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740052d0 con 0x7f04800afe10 2024-03-18T18:09:22.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0474005430 con 0x7f04800afe10 2024-03-18T18:09:22.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f422927f700 1 -- start start 2024-03-18T18:09:22.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04800a9520 con 0x7f04800afe10 2024-03-18T18:09:22.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 -- 172.21.15.94:0/2740804089 shutdown_connections 2024-03-18T18:09:22.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 --2- 172.21.15.94:0/2740804089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc040afc10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 -- 172.21.15.94:0/2740804089 >> 172.21.15.94:0/2740804089 conn(0x7fbc0406a330 msgr2=0x7fbc0406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0480071530 con 0x7f04800afe10 2024-03-18T18:09:22.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0622ffd700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240abf50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06240b56c0 tx=0x7f0618004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f422927f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 0x7f422406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f422927f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f42240713a0 0x7f4224071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f422927f700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240b4280 con 0x7f422406cad0 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f422927f700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4224071d70 con 0x7f42240713a0 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f422927f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422406ceb0 con 0x7f4224070370 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 Processor -- start 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 -- start start 2024-03-18T18:09:22.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740055a0 con 0x7f04800afe10 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49e59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 0x7fc4a01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49e59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 0x7fc4a01427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52638/0 (socket says 172.21.15.94:52638) 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49e59c700 1 -- 172.21.15.94:0/200530025 learned_addr learned my addr 172.21.15.94:0/200530025 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7fc49dd9b700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0146290 0x7fc4a01e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49ed9d700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a01e39b0 0x7fc4a006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49e59c700 1 -- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0146290 msgr2=0x7fc4a01e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49e59c700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0146290 0x7fc4a01e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49e59c700 1 -- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a01e39b0 msgr2=0x7fc4a006eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49e59c700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a01e39b0 0x7fc4a006eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49e59c700 1 -- 172.21.15.94:0/200530025 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498009a70 con 0x7fc4a013fd30 2024-03-18T18:09:22.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49ed9d700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a01e39b0 0x7fc4a006eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:22.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49e59c700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 0x7fc4a01427e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c820 tx=0x7fc49000cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618004340 con 0x7f06240b4f00 2024-03-18T18:09:22.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061801f070 con 0x7f06240b4f00 2024-03-18T18:09:22.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180036c0 con 0x7f06240b4f00 2024-03-18T18:09:22.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06241d0640 con 0x7f06240b4f00 2024-03-18T18:09:22.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06241e04d0 con 0x7f06240b4f00 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 -- 172.21.15.94:0/2740804089 shutdown_connections 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 0x7f422406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 0x7f422406f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52640/0 (socket says 172.21.15.94:52640) 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 -- 172.21.15.94:0/3446264469 learned_addr learned my addr 172.21.15.94:0/3446264469 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 -- 172.21.15.94:0/3446264469 >> v2:172.21.15.94:3300/0 conn(0x7f42240713a0 msgr2=0x7f4224071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 --2- 172.21.15.94:0/3446264469 >> v2:172.21.15.94:3300/0 conn(0x7f42240713a0 0x7f4224071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 -- 172.21.15.94:0/3446264469 >> v1:172.21.15.94:6789/0 conn(0x7f422406cad0 legacy=0x7f4224147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 -- 172.21.15.94:0/3446264469 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240708c0 con 0x7f4224070370 2024-03-18T18:09:22.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f42237fe700 1 --2- 172.21.15.94:0/3446264469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 0x7f422406f660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4218009910 tx=0x7f4218009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5258fb49567aead server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4222ffd700 1 -- 172.21.15.94:0/3446264469 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218004230 con 0x7f4224070370 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490011800 con 0x7fc4a013fd30 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc490011960 con 0x7fc4a013fd30 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490011cf0 con 0x7fc4a013fd30 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a00b1110 con 0x7fc4a013fd30 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a00a8f80 con 0x7fc4a013fd30 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67a813fd30 0x7f67a8140190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a8146200 0x7f67a8146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a80b0b00 con 0x7f67a80aea70 2024-03-18T18:09:22.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a80b5340 con 0x7f67a813fd30 2024-03-18T18:09:22.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67aee5b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a81406d0 con 0x7f67a8146200 2024-03-18T18:09:22.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f04740036a0 con 0x7f04800afe10 2024-03-18T18:09:22.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4222ffd700 1 -- 172.21.15.94:0/3446264469 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218004390 con 0x7f4224070370 2024-03-18T18:09:22.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4222ffd700 1 -- 172.21.15.94:0/3446264469 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218009e60 con 0x7f4224070370 2024-03-18T18:09:22.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0467fff700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f046c066730 0x7f046c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0474083240 con 0x7f04800afe10 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.036+0000 7f407b4ff700 1 -- 172.21.15.94:0/1426924451 wait complete. 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 Processor -- start 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 -- start start 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40740ad120 0x7f407413ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740adfd0 0x7f4074144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 0x7f4074145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 0x7f4074145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 0x7f4074145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35490/0 (socket says 172.21.15.94:35490) 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 -- 172.21.15.94:0/4224854958 learned_addr learned my addr 172.21.15.94:0/4224854958 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4074145f60 con 0x7f40740b50a0 2024-03-18T18:09:22.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4074071790 con 0x7f40740adfd0 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40740a9860 con 0x7f40740ad120 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4078a9a700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740adfd0 0x7f4074144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 -- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40740ad120 msgr2=0x7f407413ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407929b700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40740ad120 0x7f407413ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40740ad120 0x7f407413ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 -- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740adfd0 msgr2=0x7f4074144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740adfd0 0x7f4074144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640094b0 con 0x7f40740b50a0 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f407929b700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40740ad120 0x7f407413ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4079a9c700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 0x7f4074145a20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f407000c400 tx=0x7f407000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4078a9a700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740adfd0 0x7f4074144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:22.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f047effd700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f046c066730 0x7f046c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67ade59700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f67a80aea70 0x7f67a80b4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:49304/0 (socket says 172.21.15.94:49304) 2024-03-18T18:09:22.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67ade59700 1 -- 172.21.15.94:0/3420454784 learned_addr learned my addr 172.21.15.94:0/3420454784 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:22.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67ad658700 1 --2- 172.21.15.94:0/3420454784 >> v2:172.21.15.151:3300/0 conn(0x7f67a813fd30 0x7f67a8140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0460005310 con 0x7f04800afe10 2024-03-18T18:09:22.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 -- 172.21.15.94:0/2740804089 wait complete. 2024-03-18T18:09:22.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67ace57700 1 -- 172.21.15.94:0/3420454784 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17298047 0 0) 0x7f67a80b0b00 con 0x7f67a80aea70 2024-03-18T18:09:22.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 Processor -- start 2024-03-18T18:09:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0618021030 con 0x7f06240b4f00 2024-03-18T18:09:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06240ae7b0 con 0x7f06240b4f00 2024-03-18T18:09:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f060b7fe700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0610066730 0x7f0610068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0618085110 con 0x7f06240b4f00 2024-03-18T18:09:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f67ace57700 1 -- 172.21.15.94:0/3420454784 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67940035d0 con 0x7f67a80aea70 2024-03-18T18:09:22.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fbc0960c700 1 -- start start 2024-03-18T18:09:22.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700052d0 con 0x7f40740b50a0 2024-03-18T18:09:22.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4070005430 con 0x7f40740b50a0 2024-03-18T18:09:22.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40740a9b40 con 0x7f40740b50a0 2024-03-18T18:09:22.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f422927f700 1 -- 172.21.15.94:0/3446264469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 msgr2=0x7f422406f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f422927f700 1 --2- 172.21.15.94:0/3446264469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 0x7f422406f660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4218009910 tx=0x7f4218009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:22.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ae65a700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a8146200 0x7f67a8146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f06227fc700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0610066730 0x7f0610068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f422927f700 1 -- 172.21.15.94:0/3446264469 shutdown_connections 2024-03-18T18:09:22.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f422927f700 1 --2- 172.21.15.94:0/3446264469 >> v2:172.21.15.94:3300/0 conn(0x7f42240713a0 0x7f4224071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f422927f700 1 --2- 172.21.15.94:0/3446264469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224070370 0x7f422406f660 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4218009910 tx=0x7f4218009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:22.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f422927f700 1 -- 172.21.15.94:0/3446264469 >> 172.21.15.94:0/3446264469 conn(0x7f42240b56a0 msgr2=0x7f42240b5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.040+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0074440 con 0x7fc4a013fd30 2024-03-18T18:09:22.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ace57700 1 -- 172.21.15.94:0/3420454784 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2122711256 0 0) 0x7f67940035d0 con 0x7f67a80aea70 2024-03-18T18:09:22.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ad658700 1 -- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a8146200 msgr2=0x7f67a8146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:22.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ad658700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a8146200 0x7f67a8146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ad658700 1 -- 172.21.15.94:0/3420454784 >> v1:172.21.15.151:6789/0 conn(0x7f67a80aea70 legacy=0x7f67a80b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.085 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ad658700 1 -- 172.21.15.94:0/3420454784 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a80b0540 con 0x7f67a813fd30 2024-03-18T18:09:22.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 -- 172.21.15.94:0/1617107212 shutdown_connections 2024-03-18T18:09:22.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ae65a700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a8146200 0x7f67a8146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:22.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc0960c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc040b1e10 0x7fbc0414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc0960c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc0413c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc0960c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc04144e40 0x7fbc0413ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc0960c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040af000 con 0x7fbc040b1e10 2024-03-18T18:09:22.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc0960c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0414a010 con 0x7fbc04144e40 2024-03-18T18:09:22.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc0960c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04140d80 con 0x7fbc040b4ea0 2024-03-18T18:09:22.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ad658700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a813fd30 0x7f67a8140190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009d90 tx=0x7f67a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=836d30c75d8840e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc0413c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc037fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc04144e40 0x7fbc0413ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc0413c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52668/0 (socket says 172.21.15.94:52668) 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 -- 172.21.15.94:0/924815944 learned_addr learned my addr 172.21.15.94:0/924815944 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ace57700 1 -- 172.21.15.94:0/3420454784 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a000e070 con 0x7f67a813fd30 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ace57700 1 -- 172.21.15.94:0/3420454784 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a0003a40 con 0x7f67a813fd30 2024-03-18T18:09:22.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67ace57700 1 -- 172.21.15.94:0/3420454784 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4001670 con 0x7f67a813fd30 2024-03-18T18:09:22.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc490024480 con 0x7fc4a013fd30 2024-03-18T18:09:22.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f047effd700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f046c066730 0x7f046c068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f048012e2f0 tx=0x7f0478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700055a0 con 0x7f40740b50a0 2024-03-18T18:09:22.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407413a600 con 0x7f40740b50a0 2024-03-18T18:09:22.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 -- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc04144e40 msgr2=0x7fbc0413ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc04144e40 0x7fbc0413ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 -- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc040b1e10 msgr2=0x7fbc0414a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc040b1e10 0x7fbc0414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 -- 172.21.15.94:0/924815944 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80094b0 con 0x7fbc040b4ea0 2024-03-18T18:09:22.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fbc027fc700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc0413c4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00cbc0 tx=0x7fbbfc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fc48effd700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fc480066780 0x7fc480068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 -- 172.21.15.94:0/1617107212 wait complete. 2024-03-18T18:09:22.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fc49dd9b700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fc480066780 0x7fc480068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc490084360 con 0x7fc4a013fd30 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 -- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a813fd30 msgr2=0x7f67a8140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a813fd30 0x7f67a8140190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009d90 tx=0x7f67a000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 -- 172.21.15.94:0/3420454784 shutdown_connections 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a8146200 0x7f67a8146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 --2- 172.21.15.94:0/3420454784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a813fd30 0x7f67a8140190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 -- 172.21.15.94:0/3420454784 >> 172.21.15.94:0/3420454784 conn(0x7f67a806a330 msgr2=0x7f67a806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 -- 172.21.15.94:0/3420454784 shutdown_connections 2024-03-18T18:09:22.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 -- 172.21.15.94:0/3420454784 wait complete. 2024-03-18T18:09:22.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7fc49dd9b700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fc480066780 0x7fc480068c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00b3a40 tx=0x7fc494009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 Processor -- start 2024-03-18T18:09:22.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 -- start start 2024-03-18T18:09:22.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 Processor -- start 2024-03-18T18:09:22.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f67aee5b700 1 -- start start 2024-03-18T18:09:22.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 0x7f63400a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6340144e40 0x7f63400a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63400aa270 0x7f63401e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400a85d0 con 0x7f6340144e40 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400a8b90 con 0x7f63400aa270 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.044+0000 7f63451dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340147cc0 con 0x7f63400b4a50 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 -- 172.21.15.94:0/3446264469 shutdown_connections 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 0x7f63400a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 0x7f63400a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52678/0 (socket says 172.21.15.94:52678) 2024-03-18T18:09:22.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 -- 172.21.15.94:0/2939255281 learned_addr learned my addr 172.21.15.94:0/2939255281 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f63449dc700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63400aa270 0x7f63401e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633f7fe700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6340144e40 0x7f63400a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 -- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63400aa270 msgr2=0x7f63401e31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63400aa270 0x7f63401e31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 -- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6340144e40 msgr2=0x7f63400a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6340144e40 0x7f63400a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 -- 172.21.15.94:0/2939255281 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330009b30 con 0x7f63400b4a50 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f633ffff700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 0x7f63400a9020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6330015040 tx=0x7f6330004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f06227fc700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0610066730 0x7f0610068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0624072150 tx=0x7f061c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4074068310 con 0x7f40740b50a0 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 -- 172.21.15.94:0/3446264469 wait complete. 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 Processor -- start 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67aee5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 0x7f67a812d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67aee5b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a8146200 0x7f67a8142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67aee5b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67a81544f0 0x7f67a8070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67aee5b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a81329d0 con 0x7f67a81544f0 2024-03-18T18:09:22.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67aee5b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a806ef80 con 0x7f67a8146200 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67aee5b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a80722e0 con 0x7f67a813fd30 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 0x7f67a812d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 0x7f67a812d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52688/0 (socket says 172.21.15.94:52688) 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 -- 172.21.15.94:0/1779459784 learned_addr learned my addr 172.21.15.94:0/1779459784 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ad658700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a8146200 0x7f67a8142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 -- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a8146200 msgr2=0x7f67a8142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a8146200 0x7f67a8142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 -- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67a81544f0 msgr2=0x7f67a8070070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67a81544f0 0x7f67a8070070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 -- 172.21.15.94:0/1779459784 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a0009a70 con 0x7f67a813fd30 2024-03-18T18:09:22.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 -- start start 2024-03-18T18:09:22.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f67ade59700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 0x7f67a812d230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f67a40011e0 tx=0x7f67a400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0618052550 con 0x7f06240b4f00 2024-03-18T18:09:22.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f422406cad0 0x7f422413cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42240713a0 0x7f4224148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 0x7f42241e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422413ed70 con 0x7f422406cad0 2024-03-18T18:09:22.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224149230 con 0x7f42240713a0 2024-03-18T18:09:22.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f422927f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422413fa00 con 0x7f4224148da0 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 0x7f42241e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f42237fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42240713a0 0x7f4224148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 0x7f42241e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:52692/0 (socket says 172.21.15.94:52692) 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f42237fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42240713a0 0x7f4224148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:57956/0 (socket says 172.21.15.94:57956) 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 -- 172.21.15.94:0/335826838 learned_addr learned my addr 172.21.15.94:0/335826838 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4223fff700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f422406cad0 0x7f422413cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 -- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42240713a0 msgr2=0x7f4224148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42240713a0 0x7f4224148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 -- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f422406cad0 msgr2=0x7f422413cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f422406cad0 0x7f422413cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 -- 172.21.15.94:0/335826838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009570 con 0x7f4224148da0 2024-03-18T18:09:22.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4223fff700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f422406cad0 0x7f422413cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:22.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4070006ac0 con 0x7f40740b50a0 2024-03-18T18:09:22.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4228a7e700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 0x7f42241e3190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f421c00b970 tx=0x7f421c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f4069ffb700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4058066760 0x7f4058068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f407929b700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4058066760 0x7f4058068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.048+0000 7f407929b700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4058066760 0x7f4058068c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f406c0012e0 tx=0x7f406c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330004440 con 0x7f63400b4a50 2024-03-18T18:09:22.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00a820 con 0x7fbc040b4ea0 2024-03-18T18:09:22.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc041490b0 con 0x7fbc040b4ea0 2024-03-18T18:09:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63400ab1f0 con 0x7f63400b4a50 2024-03-18T18:09:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc00a980 con 0x7fbc040b4ea0 2024-03-18T18:09:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00ad10 con 0x7fbc040b4ea0 2024-03-18T18:09:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63400a8820 con 0x7f63400b4a50 2024-03-18T18:09:22.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0414b600 con 0x7fbc040b4ea0 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4004ca0 con 0x7f67a813fd30 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a8132330 con 0x7f67a813fd30 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a4004e20 con 0x7f67a813fd30 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4007310 con 0x7f67a813fd30 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a806fbe0 con 0x7f67a813fd30 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300094d0 con 0x7f63400b4a50 2024-03-18T18:09:22.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300047c0 con 0x7f63400b4a50 2024-03-18T18:09:22.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc490051840 con 0x7fc4a013fd30 2024-03-18T18:09:22.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4070055040 con 0x7f40740b50a0 2024-03-18T18:09:22.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.052+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0474050640 con 0x7f04800afe10 2024-03-18T18:09:22.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.056+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc04149e70 con 0x7fbc040b4ea0 2024-03-18T18:09:22.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.056+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f67a4007470 con 0x7f67a813fd30 2024-03-18T18:09:22.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.056+0000 7f679e7fc700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f678c066730 0x7f678c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.056+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67a4083ea0 con 0x7f67a813fd30 2024-03-18T18:09:22.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.056+0000 7f67ad658700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f678c066730 0x7f678c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.056+0000 7f67ad658700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f678c066730 0x7f678c068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67a000b370 tx=0x7f67a0011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00d860 con 0x7f4224148da0 2024-03-18T18:09:22.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c00d9e0 con 0x7f4224148da0 2024-03-18T18:09:22.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422413fce0 con 0x7f4224148da0 2024-03-18T18:09:22.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00dd90 con 0x7f4224148da0 2024-03-18T18:09:22.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422413ea00 con 0x7f4224148da0 2024-03-18T18:09:22.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6790005310 con 0x7f67a813fd30 2024-03-18T18:09:22.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6324005310 con 0x7f63400b4a50 2024-03-18T18:09:22.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422413eee0 con 0x7f4224148da0 2024-03-18T18:09:22.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.060+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4070050c80 con 0x7f40740b50a0 2024-03-18T18:09:22.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.064+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f421c0203f0 con 0x7f4224148da0 2024-03-18T18:09:22.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.064+0000 7f4220ff9700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4210066780 0x7f4210068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.064+0000 7f4223fff700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4210066780 0x7f4210068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.064+0000 7f4223fff700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4210066780 0x7f4210068c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4214007fd0 tx=0x7f4214009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6330012430 con 0x7f63400b4a50 2024-03-18T18:09:22.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbbfc01b3b0 con 0x7fbc040b4ea0 2024-03-18T18:09:22.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f633cff9700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6320066730 0x7f6320068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7fbbeb7fe700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbbf0066730 0x7fbbf0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:22.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63300854d0 con 0x7f63400b4a50 2024-03-18T18:09:22.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f633f7fe700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6320066730 0x7f6320068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7fbc02ffd700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbbf0066730 0x7fbbf0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:22.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbfc083cd0 con 0x7fbc040b4ea0 2024-03-18T18:09:22.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6330087a60 con 0x7f63400b4a50 2024-03-18T18:09:22.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbc04149e70 con 0x7fbc040b4ea0 2024-03-18T18:09:22.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f633f7fe700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6320066730 0x7f6320068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63400a84f0 tx=0x7f6338009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7fbc02ffd700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbbf0066730 0x7fbbf0068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009880 tx=0x7fbbf8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:22.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.068+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f421c055d30 con 0x7f4224148da0 2024-03-18T18:09:22.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.072+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f67a40512a0 con 0x7f67a813fd30 2024-03-18T18:09:22.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.080+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f421c051970 con 0x7f4224148da0 2024-03-18T18:09:22.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.360+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0624074440 con 0x7f06240b4f00 2024-03-18T18:09:22.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.364+0000 7f060b7fe700 1 -- 172.21.15.94:0/1373338627 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0618055b70 con 0x7f06240b4f00 2024-03-18T18:09:22.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.364+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0460005890 con 0x7f04800afe10 2024-03-18T18:09:22.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.368+0000 7f0467fff700 1 -- 172.21.15.94:0/339126127 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0474053c60 con 0x7f04800afe10 2024-03-18T18:09:22.367 INFO:teuthology.orchestra.run.smithi094.stdout:68719476742 2024-03-18T18:09:22.370 INFO:teuthology.orchestra.run.smithi094.stdout:64424509446 2024-03-18T18:09:22.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f046c066730 msgr2=0x7f046c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f046c066730 0x7f046c068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f048012e2f0 tx=0x7f0478009040 comp rx=0 tx=0).stop 2024-03-18T18:09:22.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 msgr2=0x7f04801df820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f04801df820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f047400c500 tx=0x7f047400c810 comp rx=0 tx=0).stop 2024-03-18T18:09:22.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 shutdown_connections 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f046c066730 0x7f046c068bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04800b0d60 0x7f048013f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04800b0980 0x7f04800a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 --2- 172.21.15.94:0/339126127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04800afe10 0x7f04801df820 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 >> 172.21.15.94:0/339126127 conn(0x7f048006a780 msgr2=0x7f0480141600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 shutdown_connections 2024-03-18T18:09:22.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.372+0000 7f0484ae0700 1 -- 172.21.15.94:0/339126127 wait complete. 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0610066730 msgr2=0x7f0610068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0610066730 0x7f0610068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0624072150 tx=0x7f061c009040 comp rx=0 tx=0).stop 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 msgr2=0x7f06240abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240abf50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06240b56c0 tx=0x7f0618004770 comp rx=0 tx=0).stop 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 shutdown_connections 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0610066730 0x7f0610068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f062414a7a0 0x7f06241d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0624149c00 0x7f06240aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 --2- 172.21.15.94:0/1373338627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06240b4f00 0x7f06240abf50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 >> 172.21.15.94:0/1373338627 conn(0x7f062406a330 msgr2=0x7f06240b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 shutdown_connections 2024-03-18T18:09:22.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7f0623fff700 1 -- 172.21.15.94:0/1373338627 wait complete. 2024-03-18T18:09:22.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbc04149e70 con 0x7fbc040b4ea0 2024-03-18T18:09:22.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc4a01e31d0 con 0x7fc4a013fd30 2024-03-18T18:09:22.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.376+0000 7fbbeb7fe700 1 -- 172.21.15.94:0/924815944 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc04149e70 con 0x7fbc040b4ea0 2024-03-18T18:09:22.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fc48effd700 1 -- 172.21.15.94:0/200530025 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc490054e60 con 0x7fc4a013fd30 2024-03-18T18:09:22.379 INFO:teuthology.orchestra.run.smithi094.stdout:64424509446 2024-03-18T18:09:22.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40740b7620 con 0x7f40740b50a0 2024-03-18T18:09:22.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbbf0066730 msgr2=0x7fbbf0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbbf0066730 0x7fbbf0068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009880 tx=0x7fbbf8010000 comp rx=0 tx=0).stop 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 msgr2=0x7fbc0413c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc0413c4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00cbc0 tx=0x7fbbfc00cbf0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 shutdown_connections 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbbf0066730 0x7fbbf0068bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc04144e40 0x7fbc0413ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc040b4ea0 0x7fbc0413c4f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 --2- 172.21.15.94:0/924815944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbc040b1e10 0x7fbc0414a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 >> 172.21.15.94:0/924815944 conn(0x7fbc0406a330 msgr2=0x7fbc040b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 shutdown_connections 2024-03-18T18:09:22.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.380+0000 7fbc0960c700 1 -- 172.21.15.94:0/924815944 wait complete. 2024-03-18T18:09:22.384 INFO:teuthology.orchestra.run.smithi094.stdout:68719476742 2024-03-18T18:09:22.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476742 for osd.7 2024-03-18T18:09:22.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fc480066780 msgr2=0x7fc480068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fc480066780 0x7fc480068c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00b3a40 tx=0x7fc494009040 comp rx=0 tx=0).stop 2024-03-18T18:09:22.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 msgr2=0x7fc4a01427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 0x7fc4a01427e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c820 tx=0x7fc49000cb30 comp rx=0 tx=0).stop 2024-03-18T18:09:22.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 shutdown_connections 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fc480066780 0x7fc480068c40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a01e39b0 0x7fc4a006eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0146290 0x7fc4a01e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 --2- 172.21.15.94:0/200530025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a013fd30 0x7fc4a01427e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 >> 172.21.15.94:0/200530025 conn(0x7fc4a006a330 msgr2=0x7fc4a01447c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 shutdown_connections 2024-03-18T18:09:22.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.384+0000 7fc49f59e700 1 -- 172.21.15.94:0/200530025 wait complete. 2024-03-18T18:09:22.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6790005890 con 0x7f67a813fd30 2024-03-18T18:09:22.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f679e7fc700 1 -- 172.21.15.94:0/1779459784 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67a4007720 con 0x7f67a813fd30 2024-03-18T18:09:22.388 INFO:teuthology.orchestra.run.smithi094.stdout:68719476742 2024-03-18T18:09:22.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63240055c0 con 0x7f63400b4a50 2024-03-18T18:09:22.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f4069ffb700 1 -- 172.21.15.94:0/4224854958 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4070020020 con 0x7f40740b50a0 2024-03-18T18:09:22.390 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-03-18T18:09:22.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f678c066730 msgr2=0x7f678c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f678c066730 0x7f678c068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67a000b370 tx=0x7f67a0011000 comp rx=0 tx=0).stop 2024-03-18T18:09:22.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f633cff9700 1 -- 172.21.15.94:0/2939255281 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6330052860 con 0x7f63400b4a50 2024-03-18T18:09:22.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 msgr2=0x7f67a812d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 0x7f67a812d230 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f67a40011e0 tx=0x7f67a400c9e0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 shutdown_connections 2024-03-18T18:09:22.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f678c066730 0x7f678c068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.392 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-03-18T18:09:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67a81544f0 0x7f67a8070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67a8146200 0x7f67a8142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 --2- 172.21.15.94:0/1779459784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67a813fd30 0x7f67a812d230 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 >> 172.21.15.94:0/1779459784 conn(0x7f67a806a330 msgr2=0x7f67a80b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.388+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 shutdown_connections 2024-03-18T18:09:22.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f67aee5b700 1 -- 172.21.15.94:0/1779459784 wait complete. 2024-03-18T18:09:22.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-03-18T18:09:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4058066760 msgr2=0x7f4058068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4058066760 0x7f4058068c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f406c0012e0 tx=0x7f406c009040 comp rx=0 tx=0).stop 2024-03-18T18:09:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 msgr2=0x7f4074145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 0x7f4074145a20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f407000c400 tx=0x7f407000c7c0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 shutdown_connections 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4058066760 0x7f4058068c20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f40740b50a0 0x7f4074145a20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740adfd0 0x7f4074144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 --2- 172.21.15.94:0/4224854958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40740ad120 0x7f407413ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 >> 172.21.15.94:0/4224854958 conn(0x7f407406a330 msgr2=0x7f407406a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 shutdown_connections 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f407b4ff700 1 -- 172.21.15.94:0/4224854958 wait complete. 2024-03-18T18:09:22.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4224074440 con 0x7f4224148da0 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6320066730 msgr2=0x7f6320068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6320066730 0x7f6320068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63400a84f0 tx=0x7f6338009190 comp rx=0 tx=0).stop 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 msgr2=0x7f63400a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 0x7f63400a9020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6330015040 tx=0x7f6330004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 shutdown_connections 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6320066730 0x7f6320068bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63400aa270 0x7f63401e31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6340144e40 0x7f63400a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 --2- 172.21.15.94:0/2939255281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63400b4a50 0x7f63400a9020 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 >> 172.21.15.94:0/2939255281 conn(0x7f634006a330 msgr2=0x7f63400b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f4220ff9700 1 -- 172.21.15.94:0/335826838 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f421c054f90 con 0x7f4224148da0 2024-03-18T18:09:22.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 shutdown_connections 2024-03-18T18:09:22.397 INFO:teuthology.orchestra.run.smithi094.stdout:68719476740 2024-03-18T18:09:22.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.392+0000 7f63451dd700 1 -- 172.21.15.94:0/2939255281 wait complete. 2024-03-18T18:09:22.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-03-18T18:09:22.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4210066780 msgr2=0x7f4210068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4210066780 0x7f4210068c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4214007fd0 tx=0x7f4214009040 comp rx=0 tx=0).stop 2024-03-18T18:09:22.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 msgr2=0x7f42241e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:22.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 0x7f42241e3190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f421c00b970 tx=0x7f421c00bc80 comp rx=0 tx=0).stop 2024-03-18T18:09:22.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 shutdown_connections 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4210066780 0x7f4210068c40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4224148da0 0x7f42241e3190 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42240713a0 0x7f4224148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 --2- 172.21.15.94:0/335826838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f422406cad0 0x7f422413cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 >> 172.21.15.94:0/335826838 conn(0x7f42240b56a0 msgr2=0x7f4224142300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 shutdown_connections 2024-03-18T18:09:22.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:22.396+0000 7f422927f700 1 -- 172.21.15.94:0/335826838 wait complete. 2024-03-18T18:09:22.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476742 for osd.5 2024-03-18T18:09:22.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476742 for osd.6 2024-03-18T18:09:22.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476740 for osd.4 2024-03-18T18:09:22.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-03-18T18:09:22.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2024-03-18T18:09:23.386 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-18T18:09:23.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T18:09:23.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T18:09:23.406 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-18T18:09:23.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-18T18:09:23.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-18T18:09:23.411 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T18:09:23.412 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T18:09:23.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 Processor -- start 2024-03-18T18:09:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 -- start start 2024-03-18T18:09:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa02c0afcc0 0x7fa02c0af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa02c0b5100 0x7fa02c14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c142520 con 0x7fa02c0b4d20 2024-03-18T18:09:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0b1460 con 0x7fa02c0b5100 2024-03-18T18:09:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa0339da700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c143510 con 0x7fa02c0afcc0 2024-03-18T18:09:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa031f77700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa02c0b5100 0x7fa02c14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa031f77700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa02c0b5100 0x7fa02c14ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35520/0 (socket says 172.21.15.94:35520) 2024-03-18T18:09:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa031f77700 1 -- 172.21.15.94:0/1530823354 learned_addr learned my addr 172.21.15.94:0/1530823354 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7fa030f75700 1 --2- 172.21.15.94:0/1530823354 >> v2:172.21.15.151:3300/0 conn(0x7fa02c0afcc0 0x7fa02c0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7f74eba6b700 1 Processor -- start 2024-03-18T18:09:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.524+0000 7f74eba6b700 1 -- start start 2024-03-18T18:09:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa030f75700 1 -- 172.21.15.94:0/1530823354 >> v2:172.21.15.94:3300/0 conn(0x7fa02c0b5100 msgr2=0x7fa02c14ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa030f75700 1 --2- 172.21.15.94:0/1530823354 >> v2:172.21.15.94:3300/0 conn(0x7fa02c0b5100 0x7fa02c14ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa030f75700 1 -- 172.21.15.94:0/1530823354 >> v1:172.21.15.151:6789/0 conn(0x7fa02c0b4d20 legacy=0x7fa02c142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa030f75700 1 -- 172.21.15.94:0/1530823354 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0b0320 con 0x7fa02c0afcc0 2024-03-18T18:09:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa030f75700 1 --2- 172.21.15.94:0/1530823354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0af240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0b16c0 tx=0x7fa01c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a35ba1c11c689d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74e40b4d20 0x7f74e4142e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e40af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa023fff700 1 -- 172.21.15.94:0/1530823354 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c004230 con 0x7fa02c0afcc0 2024-03-18T18:09:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa023fff700 1 -- 172.21.15.94:0/1530823354 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c004390 con 0x7fa02c0afcc0 2024-03-18T18:09:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa023fff700 1 -- 172.21.15.94:0/1530823354 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0036c0 con 0x7fa02c0afcc0 2024-03-18T18:09:23.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 -- 172.21.15.94:0/1530823354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 msgr2=0x7fa02c0af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 --2- 172.21.15.94:0/1530823354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0af240 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0b16c0 tx=0x7fa01c009b30 comp rx=0 tx=0).stop 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74e40b5100 0x7f74e40b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40b1460 con 0x7f74e40b4d20 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40b48a0 con 0x7f74e40b5100 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4142520 con 0x7f74e40afcc0 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74e40b4d20 0x7f74e4142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f74e40b4d20 0x7f74e4142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35522/0 (socket says 172.21.15.94:35522) 2024-03-18T18:09:23.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 -- 172.21.15.94:0/983453268 learned_addr learned my addr 172.21.15.94:0/983453268 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9006700 1 --2- 172.21.15.94:0/983453268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e40af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 -- 172.21.15.94:0/983453268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 msgr2=0x7f74e40af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 --2- 172.21.15.94:0/983453268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e40af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 -- 172.21.15.94:0/983453268 >> v2:172.21.15.151:3300/0 conn(0x7f74e40b5100 msgr2=0x7f74e40b4360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 --2- 172.21.15.94:0/983453268 >> v2:172.21.15.151:3300/0 conn(0x7f74e40b5100 0x7f74e40b4360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 -- 172.21.15.94:0/983453268 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40b0320 con 0x7f74e40b4d20 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e9807700 1 --2- 172.21.15.94:0/983453268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b4d20 0x7f74e4142e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f74e40b5990 tx=0x7f74dc014ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612d7131d810b8bb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e8805700 1 -- 172.21.15.94:0/983453268 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc013cf0 con 0x7f74e40b4d20 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e8805700 1 -- 172.21.15.94:0/983453268 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc013e50 con 0x7f74e40b4d20 2024-03-18T18:09:23.531 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74e8805700 1 -- 172.21.15.94:0/983453268 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00f260 con 0x7f74e40b4d20 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 -- 172.21.15.94:0/1530823354 shutdown_connections 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 --2- 172.21.15.94:0/1530823354 >> v2:172.21.15.94:3300/0 conn(0x7fa02c0b5100 0x7fa02c14ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 --2- 172.21.15.94:0/1530823354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0af240 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 -- 172.21.15.94:0/1530823354 >> 172.21.15.94:0/1530823354 conn(0x7fa02c06a330 msgr2=0x7fa02c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 -- 172.21.15.94:0/1530823354 shutdown_connections 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- 172.21.15.94:0/983453268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b4d20 msgr2=0x7f74e4142e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- 172.21.15.94:0/983453268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b4d20 0x7f74e4142e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f74e40b5990 tx=0x7f74dc014ce0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7fa0339da700 1 -- 172.21.15.94:0/1530823354 wait complete. 2024-03-18T18:09:23.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- 172.21.15.94:0/983453268 shutdown_connections 2024-03-18T18:09:23.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- 172.21.15.94:0/983453268 >> v2:172.21.15.151:3300/0 conn(0x7f74e40b5100 0x7f74e40b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- 172.21.15.94:0/983453268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e40af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 --2- 172.21.15.94:0/983453268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b4d20 0x7f74e4142e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- 172.21.15.94:0/983453268 >> 172.21.15.94:0/983453268 conn(0x7f74e406a330 msgr2=0x7f74e406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- 172.21.15.94:0/983453268 shutdown_connections 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.528+0000 7f74eba6b700 1 -- 172.21.15.94:0/983453268 wait complete. 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 Processor -- start 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 Processor -- start 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 -- start start 2024-03-18T18:09:23.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02c0b4d20 0x7fa02c137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 0x7fa02c1e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c1440d0 con 0x7fa02c0b5100 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c1469a0 con 0x7fa02c0afcc0 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa0339da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c1e38c0 con 0x7fa02c0b4d20 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 0x7fa02c1e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 0x7fa02c1e02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35538/0 (socket says 172.21.15.94:35538) 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa030f75700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02c0b4d20 0x7fa02c137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 -- 172.21.15.94:0/143448015 learned_addr learned my addr 172.21.15.94:0/143448015 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.535 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031776700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 -- start start 2024-03-18T18:09:23.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40b4d20 0x7f74e406f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 0x7f74e406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4070b10 con 0x7f74e40b5100 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4070df0 con 0x7f74e40b4d20 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74eba6b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e413eff0 con 0x7f74e40afcc0 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74ea008700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 0x7f74e406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74ea008700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 0x7f74e406fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35540/0 (socket says 172.21.15.94:35540) 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74ea008700 1 -- 172.21.15.94:0/304214917 learned_addr learned my addr 172.21.15.94:0/304214917 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9807700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40b4d20 0x7f74e406f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 -- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 msgr2=0x7f74e406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 -- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 msgr2=0x7f74e406fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 0x7f74e406fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 -- 172.21.15.94:0/304214917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc014660 con 0x7f74e40b4d20 2024-03-18T18:09:23.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74ea008700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 0x7f74e406fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 -- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02c0b4d20 msgr2=0x7fa02c137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02c0b4d20 0x7fa02c137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 -- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 msgr2=0x7fa02c0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 -- 172.21.15.94:0/143448015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0094b0 con 0x7fa02c0b5100 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7fa031f77700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 0x7fa02c1e02f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa024004660 tx=0x7fa024004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.532+0000 7f74e9006700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40b4d20 0x7f74e406f6e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f74d400d5c0 tx=0x7f74d400d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40125f0 con 0x7f74e40b4d20 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d4012750 con 0x7f74e40b4d20 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4012b00 con 0x7f74e40b4d20 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e40718d0 con 0x7f74e40b4d20 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e413fdf0 con 0x7f74e40b4d20 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024003bd0 con 0x7fa02c0b5100 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0240106f0 con 0x7fa02c0b5100 2024-03-18T18:09:23.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024010aa0 con 0x7fa02c0b5100 2024-03-18T18:09:23.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7fa0339da700 1 -- 172.21.15.94:0/143448015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c1e3c00 con 0x7fa02c0b5100 2024-03-18T18:09:23.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7fa0339da700 1 -- 172.21.15.94:0/143448015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c13fe20 con 0x7fa02c0b5100 2024-03-18T18:09:23.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f74d4012c60 con 0x7f74e40b4d20 2024-03-18T18:09:23.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7f74da7fc700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f74c8066730 0x7f74c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d40840c0 con 0x7f74e40b4d20 2024-03-18T18:09:23.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f74e9807700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f74c8066730 0x7f74c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.536+0000 7fa0339da700 1 -- 172.21.15.94:0/143448015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c005310 con 0x7fa02c0b5100 2024-03-18T18:09:23.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa024016070 con 0x7fa02c0b5100 2024-03-18T18:09:23.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 Processor -- start 2024-03-18T18:09:23.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 -- start start 2024-03-18T18:09:23.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f74e9807700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f74c8066730 0x7f74c8068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74dc014d20 tx=0x7f74dc011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7fa021ffb700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa010066730 0x7fa010068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa024084770 con 0x7fa02c0b5100 2024-03-18T18:09:23.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7fa031776700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa010066730 0x7fa010068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc005310 con 0x7f74e40b4d20 2024-03-18T18:09:23.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4aec0b4ea0 0x7f4aec0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b1e10 0x7f4aec0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec0af550 con 0x7f4aec0b3f40 2024-03-18T18:09:23.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec0b0d30 con 0x7f4aec0b4ea0 2024-03-18T18:09:23.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4af254c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0af000 con 0x7f4aec0b1e10 2024-03-18T18:09:23.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7fa031776700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa010066730 0x7fa010068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa028005150 tx=0x7fa028007ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4aec0b4ea0 0x7f4aec0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aeb7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b1e10 0x7f4aec0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4aec0b4ea0 0x7f4aec0afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35544/0 (socket says 172.21.15.94:35544) 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 -- 172.21.15.94:0/3783261415 learned_addr learned my addr 172.21.15.94:0/3783261415 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 -- 172.21.15.94:0/3783261415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b1e10 msgr2=0x7f4aec0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 --2- 172.21.15.94:0/3783261415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b1e10 0x7f4aec0b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 -- 172.21.15.94:0/3783261415 >> v1:172.21.15.151:6789/0 conn(0x7f4aec0b3f40 legacy=0x7f4aec144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 -- 172.21.15.94:0/3783261415 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0b5280 con 0x7f4aec0b4ea0 2024-03-18T18:09:23.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.540+0000 7f4aebfff700 1 --2- 172.21.15.94:0/3783261415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0afc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009910 tx=0x7f4adc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469d2dfcd7f8cf84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4aeaffd700 1 -- 172.21.15.94:0/3783261415 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc011830 con 0x7f4aec0b4ea0 2024-03-18T18:09:23.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa024051b70 con 0x7fa02c0b5100 2024-03-18T18:09:23.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4aeaffd700 1 -- 172.21.15.94:0/3783261415 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc011990 con 0x7f4aec0b4ea0 2024-03-18T18:09:23.549 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4aeaffd700 1 -- 172.21.15.94:0/3783261415 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc011d40 con 0x7f4aec0b4ea0 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 -- 172.21.15.94:0/3783261415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b4ea0 msgr2=0x7f4aec0afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 --2- 172.21.15.94:0/3783261415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0afc10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009910 tx=0x7f4adc009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 -- 172.21.15.94:0/3783261415 shutdown_connections 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 --2- 172.21.15.94:0/3783261415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b1e10 0x7f4aec0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 --2- 172.21.15.94:0/3783261415 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0afc10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 -- 172.21.15.94:0/3783261415 >> 172.21.15.94:0/3783261415 conn(0x7f4aec06a330 msgr2=0x7f4aec06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 -- 172.21.15.94:0/3783261415 shutdown_connections 2024-03-18T18:09:23.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.548+0000 7f4af254c700 1 -- 172.21.15.94:0/3783261415 wait complete. 2024-03-18T18:09:23.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 Processor -- start 2024-03-18T18:09:23.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 -- start start 2024-03-18T18:09:23.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 0x7f4aec0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b3f40 0x7f4aec0a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0ab060 con 0x7f4aec0b1e10 2024-03-18T18:09:23.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1e01b0 con 0x7f4aec0b4ea0 2024-03-18T18:09:23.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af254c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1e0490 con 0x7f4aec0b3f40 2024-03-18T18:09:23.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 0x7f4aec0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 0x7f4aec0a9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35552/0 (socket says 172.21.15.94:35552) 2024-03-18T18:09:23.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 -- 172.21.15.94:0/2876397928 learned_addr learned my addr 172.21.15.94:0/2876397928 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4af0ae9700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aeb7fe700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b3f40 0x7f4aec0a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f74d4051420 con 0x7f74e40b4d20 2024-03-18T18:09:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 -- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b3f40 msgr2=0x7f4aec0a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b3f40 0x7f4aec0a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 -- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aec0b4ea0 msgr2=0x7f4aec0a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0a8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.552+0000 7f4aebfff700 1 -- 172.21.15.94:0/2876397928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc009570 con 0x7f4aec0b1e10 2024-03-18T18:09:23.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4aebfff700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 0x7f4aec0a9c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0b56c0 tx=0x7f4adc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc004590 con 0x7f4aec0b1e10 2024-03-18T18:09:23.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc01e070 con 0x7f4aec0b1e10 2024-03-18T18:09:23.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc003900 con 0x7f4aec0b1e10 2024-03-18T18:09:23.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec1e0770 con 0x7f4aec0b1e10 2024-03-18T18:09:23.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec1dfda0 con 0x7f4aec0b1e10 2024-03-18T18:09:23.558 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.556+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4adc003a60 con 0x7f4aec0b1e10 2024-03-18T18:09:23.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.560+0000 7f4ae8ff9700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4ad8066780 0x7f4ad8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.560+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4adc084f00 con 0x7f4aec0b1e10 2024-03-18T18:09:23.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.560+0000 7f4aeb7fe700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4ad8066780 0x7f4ad8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.560+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec074440 con 0x7f4aec0b1e10 2024-03-18T18:09:23.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.560+0000 7f4aeb7fe700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4ad8066780 0x7f4ad8068c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4aec14b6a0 tx=0x7f4ae0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.568 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.568+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4adc0523e0 con 0x7f4aec0b1e10 2024-03-18T18:09:23.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.584+0000 7f01354ad700 1 Processor -- start 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.584+0000 7f01354ad700 1 -- start start 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f01300afcc0 0x7f01300af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f013014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0130142520 con 0x7f01300b4d20 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01300b1460 con 0x7f01300afcc0 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0130143510 con 0x7f01300b5100 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012ffff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f01300b4d20 0x7f0130142e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56824/0 (socket says 172.21.15.94:56824) 2024-03-18T18:09:23.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012ffff700 1 -- 172.21.15.94:0/2341770721 learned_addr learned my addr 172.21.15.94:0/2341770721 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012f7fe700 1 --2- 172.21.15.94:0/2341770721 >> v2:172.21.15.151:3300/0 conn(0x7f01300afcc0 0x7f01300af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f0134cac700 1 --2- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f013014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012effd700 1 -- 172.21.15.94:0/2341770721 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544919083 0 0) 0x7f0130142520 con 0x7f01300b4d20 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012effd700 1 -- 172.21.15.94:0/2341770721 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01180035d0 con 0x7f01300b4d20 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012f7fe700 1 -- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 msgr2=0x7f013014ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012f7fe700 1 --2- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f013014ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012f7fe700 1 -- 172.21.15.94:0/2341770721 >> v1:172.21.15.94:6789/0 conn(0x7f01300b4d20 legacy=0x7f0130142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012effd700 1 -- 172.21.15.94:0/2341770721 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3099577979 0 0) 0x7f01180035d0 con 0x7f01300b4d20 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012f7fe700 1 -- 172.21.15.94:0/2341770721 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300b0320 con 0x7f01300afcc0 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012f7fe700 1 --2- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300afcc0 0x7f01300af240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f012800aea0 tx=0x7f012800c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfcfb8355d52059e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 Processor -- start 2024-03-18T18:09:23.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012effd700 1 -- 172.21.15.94:0/2341770721 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800f070 con 0x7f01300afcc0 2024-03-18T18:09:23.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012effd700 1 -- 172.21.15.94:0/2341770721 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128003a40 con 0x7f01300afcc0 2024-03-18T18:09:23.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f012effd700 1 -- 172.21.15.94:0/2341770721 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124004f10 con 0x7f01300afcc0 2024-03-18T18:09:23.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 -- start start 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300afcc0 msgr2=0x7f01300af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 --2- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300afcc0 0x7f01300af240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f012800aea0 tx=0x7f012800c330 comp rx=0 tx=0).stop 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- 172.21.15.94:0/2341770721 shutdown_connections 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 --2- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f013014ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 --2- 172.21.15.94:0/2341770721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300afcc0 0x7f01300af240 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- 172.21.15.94:0/2341770721 >> 172.21.15.94:0/2341770721 conn(0x7f013006a330 msgr2=0x7f013006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- 172.21.15.94:0/2341770721 shutdown_connections 2024-03-18T18:09:23.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f01354ad700 1 -- 172.21.15.94:0/2341770721 wait complete. 2024-03-18T18:09:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c142520 0x7f209c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f209c06cc80 0x7f209c0b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f209c0b0310 0x7f209c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f209c0b0310 0x7f209c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f209c0b0310 0x7f209c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35568/0 (socket says 172.21.15.94:35568) 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209b7fe700 1 -- 172.21.15.94:0/1400856055 learned_addr learned my addr 172.21.15.94:0/1400856055 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c0b0df0 con 0x7f209c0b0310 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f209c0af000 con 0x7f209c06cc80 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0b43a0 con 0x7f209c142520 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209affd700 1 --2- 172.21.15.94:0/1400856055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c142520 0x7f209c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 Processor -- start 2024-03-18T18:09:23.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 -- start start 2024-03-18T18:09:23.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209b7fe700 1 -- 172.21.15.94:0/1400856055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c142520 msgr2=0x7f209c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209b7fe700 1 --2- 172.21.15.94:0/1400856055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c142520 0x7f209c0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209b7fe700 1 -- 172.21.15.94:0/1400856055 >> v2:172.21.15.151:3300/0 conn(0x7f209c06cc80 msgr2=0x7f209c0b8210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.588+0000 7f692cbdb700 1 Processor -- start 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f692cbdb700 1 -- start start 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f692cbdb700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6928155830 0x7f6928155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f692cbdb700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280b0820 con 0x7f69280b4ab0 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f692cbdb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69280b4e90 con 0x7f6928156200 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f692cbdb700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69280aedb0 con 0x7f6928155830 2024-03-18T18:09:23.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f69277fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f69280b4ab0 0x7f69280b0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:56830/0 (socket says 172.21.15.94:56830) 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01300afcc0 0x7f01301dc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 0x7f013013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f0130139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01301dbe70 con 0x7f01300afcc0 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013006eb10 con 0x7f01300b4d20 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f01354ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013013e480 con 0x7f01300b5100 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f69277fe700 1 -- 172.21.15.94:0/1575096921 learned_addr learned my addr 172.21.15.94:0/1575096921 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f6926ffd700 1 --2- 172.21.15.94:0/1575096921 >> v2:172.21.15.94:3300/0 conn(0x7f6928155830 0x7f6928155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f6926ffd700 1 -- 172.21.15.94:0/1575096921 >> v1:172.21.15.151:6789/0 conn(0x7f6928156200 legacy=0x7f692815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f6926ffd700 1 -- 172.21.15.94:0/1575096921 >> v1:172.21.15.94:6789/0 conn(0x7f69280b4ab0 legacy=0x7f69280b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f6926ffd700 1 -- 172.21.15.94:0/1575096921 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928156630 con 0x7f6928155830 2024-03-18T18:09:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209a7fc700 1 --2- 172.21.15.94:0/1400856055 >> v2:172.21.15.151:3300/0 conn(0x7f209c06cc80 0x7f209c0b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209b7fe700 1 --2- 172.21.15.94:0/1400856055 >> v2:172.21.15.151:3300/0 conn(0x7f209c06cc80 0x7f209c0b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209b7fe700 1 -- 172.21.15.94:0/1400856055 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0b0830 con 0x7f209c0b0310 2024-03-18T18:09:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 0x7f013013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f0130139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 0x7f013013d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:58020/0 (socket says 172.21.15.94:58020) 2024-03-18T18:09:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012f7fe700 1 -- 172.21.15.94:0/1478252864 learned_addr learned my addr 172.21.15.94:0/1478252864 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f6926ffd700 1 --2- 172.21.15.94:0/1575096921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928155830 0x7f6928155cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f692000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9e45a4636506b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209b7fe700 1 --2- 172.21.15.94:0/1400856055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c0b0310 0x7f209c071c30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f209c0b8a70 tx=0x7f209400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e487ea599c3946ec server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012ffff700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01300afcc0 0x7f01301dc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f2099ffb700 1 -- 172.21.15.94:0/1400856055 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094010070 con 0x7f209c0b0310 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 -- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 msgr2=0x7f013013d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 0x7f013013d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 -- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01300afcc0 msgr2=0x7f01301dc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01300afcc0 0x7f01301dc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 -- 172.21.15.94:0/1478252864 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012800ab80 con 0x7f01300b5100 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012f7fe700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 0x7f013013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f2099ffb700 1 -- 172.21.15.94:0/1400856055 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209400dce0 con 0x7f209c0b0310 2024-03-18T18:09:23.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f2099ffb700 1 -- 172.21.15.94:0/1400856055 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209400b310 con 0x7f209c0b0310 2024-03-18T18:09:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f69267fc700 1 -- 172.21.15.94:0/1575096921 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920003c40 con 0x7f6928155830 2024-03-18T18:09:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f69267fc700 1 -- 172.21.15.94:0/1575096921 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6920003da0 con 0x7f6928155830 2024-03-18T18:09:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f0134cac700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f0130139d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01300739d0 tx=0x7f012000eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120013680 con 0x7f01300b5100 2024-03-18T18:09:23.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01200137e0 con 0x7f01300b5100 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c0b0310 msgr2=0x7f209c071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f209bfff700 1 --2- 172.21.15.94:0/1400856055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c0b0310 0x7f209c071c30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f209c0b8a70 tx=0x7f209400d430 comp rx=0 tx=0).stop 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 shutdown_connections 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 --2- 172.21.15.94:0/1400856055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c0b0310 0x7f209c071c30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 --2- 172.21.15.94:0/1400856055 >> v2:172.21.15.151:3300/0 conn(0x7f209c06cc80 0x7f209c0b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 --2- 172.21.15.94:0/1400856055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c142520 0x7f209c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 >> 172.21.15.94:0/1400856055 conn(0x7f209c06a780 msgr2=0x7f209c0b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 shutdown_connections 2024-03-18T18:09:23.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- 172.21.15.94:0/1400856055 wait complete. 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.592+0000 7f69267fc700 1 -- 172.21.15.94:0/1575096921 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920009310 con 0x7f6928155830 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 -- 172.21.15.94:0/1575096921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928155830 msgr2=0x7f6928155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 --2- 172.21.15.94:0/1575096921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928155830 0x7f6928155cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f69200097a0 tx=0x7f692000ccd0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 -- 172.21.15.94:0/1575096921 shutdown_connections 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 --2- 172.21.15.94:0/1575096921 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928155830 0x7f6928155cc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 -- 172.21.15.94:0/1575096921 >> 172.21.15.94:0/1575096921 conn(0x7f692806a330 msgr2=0x7f692806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 -- 172.21.15.94:0/1575096921 shutdown_connections 2024-03-18T18:09:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120013b90 con 0x7f01300b5100 2024-03-18T18:09:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01301dbb00 con 0x7f01300b5100 2024-03-18T18:09:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01301dc840 con 0x7f01300b5100 2024-03-18T18:09:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c91a8700 1 Processor -- start 2024-03-18T18:09:23.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c91a8700 1 -- start start 2024-03-18T18:09:23.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 Processor -- start 2024-03-18T18:09:23.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 -- 172.21.15.94:0/1575096921 wait complete. 2024-03-18T18:09:23.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- start start 2024-03-18T18:09:23.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c91a8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c4147060 0x7f12c41522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c91a8700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40adb10 con 0x7f12c40b4f00 2024-03-18T18:09:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c91a8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40af000 con 0x7f12c40b3f80 2024-03-18T18:09:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c91a8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40aecd0 con 0x7f12c4147060 2024-03-18T18:09:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01301dbfb0 con 0x7f01300b5100 2024-03-18T18:09:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c259c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f12c40b3f80 0x7f12c4146950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:49348/0 (socket says 172.21.15.94:49348) 2024-03-18T18:09:23.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c259c700 1 -- 172.21.15.94:0/3526895241 learned_addr learned my addr 172.21.15.94:0/3526895241 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:23.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c359e700 1 --2- 172.21.15.94:0/3526895241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c4147060 0x7f12c41522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 Processor -- start 2024-03-18T18:09:23.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c1d9b700 1 -- 172.21.15.94:0/3526895241 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578448880 0 0) 0x7f12c40af000 con 0x7f12c40b3f80 2024-03-18T18:09:23.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c1d9b700 1 -- 172.21.15.94:0/3526895241 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ac0035d0 con 0x7f12c40b3f80 2024-03-18T18:09:23.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f692cbdb700 1 -- start start 2024-03-18T18:09:23.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c359e700 1 -- 172.21.15.94:0/3526895241 >> v1:172.21.15.151:6789/0 conn(0x7f12c40b3f80 legacy=0x7f12c4146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c359e700 1 -- 172.21.15.94:0/3526895241 >> v1:172.21.15.94:6789/0 conn(0x7f12c40b4f00 legacy=0x7f12c40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c359e700 1 -- 172.21.15.94:0/3526895241 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40b52e0 con 0x7f12c4147060 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 0x7f209c0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c0b0310 0x7f209c1daa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f209c142520 0x7f209c139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c0b7f00 con 0x7f209c06cc80 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c1db440 con 0x7f209c142520 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209c1db720 con 0x7f209c0b0310 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 0x7f209c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 0x7f209c0b78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35592/0 (socket says 172.21.15.94:35592) 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 -- 172.21.15.94:0/972935421 learned_addr learned my addr 172.21.15.94:0/972935421 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 -- 172.21.15.94:0/972935421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c0b0310 msgr2=0x7f209c1daa40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c0b0310 0x7f209c1daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 -- 172.21.15.94:0/972935421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f209c142520 msgr2=0x7f209c139880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T18:09:23.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f209c142520 0x7f209c139880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 -- 172.21.15.94:0/972935421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209400bd40 con 0x7f209c06cc80 2024-03-18T18:09:23.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f070c895700 1 Processor -- start 2024-03-18T18:09:23.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0120013cf0 con 0x7f01300b5100 2024-03-18T18:09:23.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f12c359e700 1 --2- 172.21.15.94:0/3526895241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c4147060 0x7f12c41522c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009880 tx=0x7f12b4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e783897bbb63afcf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f070c895700 1 -- start start 2024-03-18T18:09:23.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f012cff9700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0118066a10 0x7f0118068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.596+0000 7f209affd700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 0x7f209c0b78e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f208c00e9d0 tx=0x7f208c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c00c850 con 0x7f209c06cc80 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c00c9b0 con 0x7f209c06cc80 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c0b73d0 con 0x7f209c06cc80 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69280b4ab0 0x7f6928070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6928155830 0x7f69280a8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 0x7f69280a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c1db160 con 0x7f209c06cc80 2024-03-18T18:09:23.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280adae0 con 0x7f6928156200 2024-03-18T18:09:23.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280713f0 con 0x7f69280b4ab0 2024-03-18T18:09:23.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69280acc10 con 0x7f6928155830 2024-03-18T18:09:23.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 0x7f69280a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 0x7f69280a8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35608/0 (socket says 172.21.15.94:35608) 2024-03-18T18:09:23.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 -- 172.21.15.94:0/459118761 learned_addr learned my addr 172.21.15.94:0/459118761 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07080b4f00 0x7f07080b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f070814a410 0x7f07081512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07080adb10 con 0x7f07080b3f80 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080aecd0 con 0x7f070814a410 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07080af000 con 0x7f07080b4f00 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f070814a410 0x7f07081512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f0706d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07080b4f00 0x7f07080b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f070814a410 0x7f07081512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:58048/0 (socket says 172.21.15.94:58048) 2024-03-18T18:09:23.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 -- 172.21.15.94:0/1548880915 learned_addr learned my addr 172.21.15.94:0/1548880915 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0120084080 con 0x7f01300b5100 2024-03-18T18:09:23.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6926ffd700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6928155830 0x7f69280a8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c00cd20 con 0x7f209c06cc80 2024-03-18T18:09:23.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f012ffff700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0118066a10 0x7f0118068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 -- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6928155830 msgr2=0x7f69280a8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6928155830 0x7f69280a8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 -- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69280b4ab0 msgr2=0x7f6928070eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T18:09:23.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69280b4ab0 0x7f6928070eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 -- 172.21.15.94:0/459118761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009a80 con 0x7f6928156200 2024-03-18T18:09:23.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f6927fff700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 0x7f69280a8980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b440 tx=0x7f691c00b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f012ffff700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0118066a10 0x7f0118068ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01240050c0 tx=0x7f0124004d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 -- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07080b4f00 msgr2=0x7f07080b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 --2- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07080b4f00 0x7f07080b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 -- 172.21.15.94:0/1548880915 >> v1:172.21.15.94:6789/0 conn(0x7f07080b3f80 legacy=0x7f0708149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:23.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 -- 172.21.15.94:0/1548880915 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080b52e0 con 0x7f070814a410 2024-03-18T18:09:23.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070759e700 1 --2- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f070814a410 0x7f07081512b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0700009e50 tx=0x7f070000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b6e3b80d652a144 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011830 con 0x7f6928156200 2024-03-18T18:09:23.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0119b0 con 0x7f6928156200 2024-03-18T18:09:23.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69280ace80 con 0x7f6928156200 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f0705d9b700 1 -- 172.21.15.94:0/1548880915 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000e070 con 0x7f070814a410 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69280ab880 con 0x7f6928156200 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f0705d9b700 1 -- 172.21.15.94:0/1548880915 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700003a40 con 0x7f070814a410 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f0705d9b700 1 -- 172.21.15.94:0/1548880915 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700003dd0 con 0x7f070814a410 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 -- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f070814a410 msgr2=0x7f07081512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f070c895700 1 --2- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f070814a410 0x7f07081512b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0700009e50 tx=0x7f070000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:23.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- 172.21.15.94:0/1548880915 shutdown_connections 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 --2- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f070814a410 0x7f07081512b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 --2- 172.21.15.94:0/1548880915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07080b4f00 0x7f07080b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- 172.21.15.94:0/1548880915 >> 172.21.15.94:0/1548880915 conn(0x7f070806a330 msgr2=0x7f070806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c005310 con 0x7f209c06cc80 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f208c013470 con 0x7f209c06cc80 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f20837fe700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2088066830 0x7f2088068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.600+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011d60 con 0x7f6928156200 2024-03-18T18:09:23.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6908005310 con 0x7f6928156200 2024-03-18T18:09:23.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f691c01a400 con 0x7f6928156200 2024-03-18T18:09:23.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f208c084220 con 0x7f209c06cc80 2024-03-18T18:09:23.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f209a7fc700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2088066830 0x7f2088068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- 172.21.15.94:0/1548880915 shutdown_connections 2024-03-18T18:09:23.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- 172.21.15.94:0/1548880915 wait complete. 2024-03-18T18:09:23.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 Processor -- start 2024-03-18T18:09:23.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f690ffff700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6914066780 0x7f6914068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f691c083f20 con 0x7f6928156200 2024-03-18T18:09:23.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f209a7fc700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2088066830 0x7f2088068cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f209c13a920 tx=0x7f2090008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- start start 2024-03-18T18:09:23.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07080b3f80 0x7f0708149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 0x7f07081d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070814a410 0x7f07081d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07081cfdf0 con 0x7f07080b4f00 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07081cf500 con 0x7f07080b3f80 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070c895700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07081d1ff0 con 0x7f070814a410 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 0x7f07081d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 0x7f07081d04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35624/0 (socket says 172.21.15.94:35624) 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.604+0000 7f070659c700 1 -- 172.21.15.94:0/663791984 learned_addr learned my addr 172.21.15.94:0/663791984 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f070659c700 1 -- 172.21.15.94:0/663791984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070814a410 msgr2=0x7f07081d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f070659c700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070814a410 0x7f07081d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f070659c700 1 -- 172.21.15.94:0/663791984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07080b3f80 msgr2=0x7f0708149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f070659c700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07080b3f80 0x7f0708149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f070659c700 1 -- 172.21.15.94:0/663791984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009b30 con 0x7f07080b4f00 2024-03-18T18:09:23.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f070659c700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 0x7f07081d04c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c4d0 tx=0x7f06fc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f12c1d9b700 1 -- 172.21.15.94:0/3526895241 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4004230 con 0x7f12c4147060 2024-03-18T18:09:23.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f12c1d9b700 1 -- 172.21.15.94:0/3526895241 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4004390 con 0x7f12c4147060 2024-03-18T18:09:23.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f12c1d9b700 1 -- 172.21.15.94:0/3526895241 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40036c0 con 0x7f12c4147060 2024-03-18T18:09:23.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.608+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f01200513e0 con 0x7f01300b5100 2024-03-18T18:09:23.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f69277fe700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6914066780 0x7f6914068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f69277fe700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6914066780 0x7f6914068c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6918001760 tx=0x7f6918007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- 172.21.15.94:0/3526895241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c4147060 msgr2=0x7f12c41522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3526895241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c4147060 0x7f12c41522c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009880 tx=0x7f12b4009b90 comp rx=0 tx=0).stop 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- 172.21.15.94:0/3526895241 shutdown_connections 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3526895241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c4147060 0x7f12c41522c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- 172.21.15.94:0/3526895241 >> 172.21.15.94:0/3526895241 conn(0x7f12c406a330 msgr2=0x7f12c406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- 172.21.15.94:0/3526895241 shutdown_connections 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- 172.21.15.94:0/3526895241 wait complete. 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 Processor -- start 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- start start 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 0x7f12c41d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c40b4f00 0x7f12c41d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c4147060 0x7f12c41d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c408ad10 con 0x7f12c4147060 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41d1770 con 0x7f12c40b3f80 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c91a8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4142c10 con 0x7f12c40b4f00 2024-03-18T18:09:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c40b4f00 0x7f12c41d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 0x7f12c41d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 0x7f12c41d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:58062/0 (socket says 172.21.15.94:58062) 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 -- 172.21.15.94:0/3414186614 learned_addr learned my addr 172.21.15.94:0/3414186614 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 -- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c40b4f00 msgr2=0x7f12c41d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c40b4f00 0x7f12c41d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 -- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c4147060 msgr2=0x7f12c41d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c4147060 0x7f12c41d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 -- 172.21.15.94:0/3414186614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40094b0 con 0x7f12c40b3f80 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.612+0000 7f12c2d9d700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 0x7f12c41d2ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12b800c500 tx=0x7f12b800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.616+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b80052d0 con 0x7f12c40b3f80 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.616+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8005430 con 0x7f12c40b3f80 2024-03-18T18:09:23.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.616+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f208c051570 con 0x7f209c06cc80 2024-03-18T18:09:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.616+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b80055a0 con 0x7f12c40b3f80 2024-03-18T18:09:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.616+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c41ced10 con 0x7f12c40b3f80 2024-03-18T18:09:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.616+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c41d09a0 con 0x7f12c40b3f80 2024-03-18T18:09:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f12b80038e0 con 0x7f12c40b3f80 2024-03-18T18:09:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0054e0 con 0x7f07080b4f00 2024-03-18T18:09:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07081cf7a0 con 0x7f07080b4f00 2024-03-18T18:09:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07081d1d10 con 0x7f07080b4f00 2024-03-18T18:09:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc0036a0 con 0x7f07080b4f00 2024-03-18T18:09:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc003a50 con 0x7f07080b4f00 2024-03-18T18:09:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.620+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f691c0b5980 con 0x7f6928156200 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c40713f0 con 0x7f12c40b3f80 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f12ab7fe700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f12b0066780 0x7f12b0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12b8083490 con 0x7f12c40b3f80 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f06fc003bb0 con 0x7f07080b4f00 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f06f77fe700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f06ec066730 0x7f06ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06fc083560 con 0x7f07080b4f00 2024-03-18T18:09:23.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f0706d9d700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f06ec066730 0x7f06ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f12c259c700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f12b0066780 0x7f12b0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:23.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.624+0000 7f0706d9d700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f06ec066730 0x7f06ec068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06f8006b40 tx=0x7f06f8006ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.628+0000 7f12c259c700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f12b0066780 0x7f12b0068c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12c40ae180 tx=0x7f12bc001d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:23.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.636+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4005310 con 0x7f07080b4f00 2024-03-18T18:09:23.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.640+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f12b8050970 con 0x7f12c40b3f80 2024-03-18T18:09:23.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.644+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f06fc050960 con 0x7f07080b4f00 2024-03-18T18:09:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.836+0000 7fa0339da700 1 -- 172.21.15.94:0/143448015 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa00c005890 con 0x7fa02c0b5100 2024-03-18T18:09:23.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.836+0000 7fa021ffb700 1 -- 172.21.15.94:0/143448015 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa02401e090 con 0x7fa02c0b5100 2024-03-18T18:09:23.838 INFO:teuthology.orchestra.run.smithi094.stdout:68719476744 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 -- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa010066730 msgr2=0x7fa010068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa010066730 0x7fa010068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa028005150 tx=0x7fa028007ee0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 -- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 msgr2=0x7fa02c1e02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 0x7fa02c1e02f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa024004660 tx=0x7fa024004690 comp rx=0 tx=0).stop 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 -- 172.21.15.94:0/143448015 shutdown_connections 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa010066730 0x7fa010068bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa02c0b5100 0x7fa02c1e02f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02c0b4d20 0x7fa02c137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 --2- 172.21.15.94:0/143448015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02c0afcc0 0x7fa02c0b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 -- 172.21.15.94:0/143448015 >> 172.21.15.94:0/143448015 conn(0x7fa02c06a330 msgr2=0x7fa02c0665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 -- 172.21.15.94:0/143448015 shutdown_connections 2024-03-18T18:09:23.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.840+0000 7fa0177fe700 1 -- 172.21.15.94:0/143448015 wait complete. 2024-03-18T18:09:23.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.7 2024-03-18T18:09:23.857 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.864+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74cc0055c0 con 0x7f74e40b4d20 2024-03-18T18:09:23.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.864+0000 7f74da7fc700 1 -- 172.21.15.94:0/304214917 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74d4054a40 con 0x7f74e40b4d20 2024-03-18T18:09:23.864 INFO:teuthology.orchestra.run.smithi094.stdout:64424509447 2024-03-18T18:09:23.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f74c8066730 msgr2=0x7f74c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f74c8066730 0x7f74c8068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74dc014d20 tx=0x7f74dc011000 comp rx=0 tx=0).stop 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40b4d20 msgr2=0x7f74e406f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40b4d20 0x7f74e406f6e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f74d400d5c0 tx=0x7f74d400d8d0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 shutdown_connections 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f74c8066730 0x7f74c8068bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f74e40b5100 0x7f74e406fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40b4d20 0x7f74e406f6e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 --2- 172.21.15.94:0/304214917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40afcc0 0x7f74e406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 >> 172.21.15.94:0/304214917 conn(0x7f74e406a330 msgr2=0x7f74e413b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 shutdown_connections 2024-03-18T18:09:23.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.868+0000 7f74eba6b700 1 -- 172.21.15.94:0/304214917 wait complete. 2024-03-18T18:09:23.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-03-18T18:09:23.881 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4aec0a8440 con 0x7f4aec0b1e10 2024-03-18T18:09:23.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4ae8ff9700 1 -- 172.21.15.94:0/2876397928 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4adc015020 con 0x7f4aec0b1e10 2024-03-18T18:09:23.883 INFO:teuthology.orchestra.run.smithi094.stdout:64424509447 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4ad8066780 msgr2=0x7f4ad8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4ad8066780 0x7f4ad8068c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4aec14b6a0 tx=0x7f4ae0008040 comp rx=0 tx=0).stop 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 msgr2=0x7f4aec0a9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 0x7f4aec0a9c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0b56c0 tx=0x7f4adc004770 comp rx=0 tx=0).stop 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 shutdown_connections 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4ad8066780 0x7f4ad8068c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aec0b4ea0 0x7f4aec0a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aec0b3f40 0x7f4aec0a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 --2- 172.21.15.94:0/2876397928 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4aec0b1e10 0x7f4aec0a9c50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.884+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 >> 172.21.15.94:0/2876397928 conn(0x7f4aec06a330 msgr2=0x7f4aec070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.888+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 shutdown_connections 2024-03-18T18:09:23.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.888+0000 7f4af254c700 1 -- 172.21.15.94:0/2876397928 wait complete. 2024-03-18T18:09:23.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-03-18T18:09:23.902 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f06e4005890 con 0x7f07080b4f00 2024-03-18T18:09:23.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f06f77fe700 1 -- 172.21.15.94:0/663791984 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06fc017030 con 0x7f07080b4f00 2024-03-18T18:09:23.908 INFO:teuthology.orchestra.run.smithi094.stdout:68719476744 2024-03-18T18:09:23.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f013013fec0 con 0x7f01300b5100 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f06ec066730 msgr2=0x7f06ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f06ec066730 0x7f06ec068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06f8006b40 tx=0x7f06f8006ad0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 msgr2=0x7f07081d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 0x7f07081d04c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c4d0 tx=0x7f06fc00c890 comp rx=0 tx=0).stop 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 shutdown_connections 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f06ec066730 0x7f06ec068bf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070814a410 0x7f07081d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f07080b4f00 0x7f07081d04c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 --2- 172.21.15.94:0/663791984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07080b3f80 0x7f0708149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 >> 172.21.15.94:0/663791984 conn(0x7f070806a330 msgr2=0x7f07080b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 shutdown_connections 2024-03-18T18:09:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.908+0000 7f070c895700 1 -- 172.21.15.94:0/663791984 wait complete. 2024-03-18T18:09:23.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f012cff9700 1 -- 172.21.15.94:0/1478252864 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0120054a00 con 0x7f01300b5100 2024-03-18T18:09:23.912 INFO:teuthology.orchestra.run.smithi094.stdout:68719476742 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0118066a10 msgr2=0x7f0118068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0118066a10 0x7f0118068ed0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01240050c0 tx=0x7f0124004d30 comp rx=0 tx=0).stop 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 msgr2=0x7f0130139d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f0130139d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01300739d0 tx=0x7f012000eb10 comp rx=0 tx=0).stop 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 shutdown_connections 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0118066a10 0x7f0118068ed0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01300b5100 0x7f0130139d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01300b4d20 0x7f013013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 --2- 172.21.15.94:0/1478252864 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f01300afcc0 0x7f01301dc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 >> 172.21.15.94:0/1478252864 conn(0x7f013006a330 msgr2=0x7f013013bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 shutdown_connections 2024-03-18T18:09:23.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.912+0000 7f01354ad700 1 -- 172.21.15.94:0/1478252864 wait complete. 2024-03-18T18:09:23.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.6 2024-03-18T18:09:23.922 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.4 2024-03-18T18:09:23.924 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.924+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f207c0055c0 con 0x7f209c06cc80 2024-03-18T18:09:23.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f20837fe700 1 -- 172.21.15.94:0/972935421 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f208c054b90 con 0x7f209c06cc80 2024-03-18T18:09:23.927 INFO:teuthology.orchestra.run.smithi094.stdout:60129542151 2024-03-18T18:09:23.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f12c4074440 con 0x7f12c40b3f80 2024-03-18T18:09:23.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12ab7fe700 1 -- 172.21.15.94:0/3414186614 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12b8017090 con 0x7f12c40b3f80 2024-03-18T18:09:23.928 INFO:teuthology.orchestra.run.smithi094.stdout:68719476744 2024-03-18T18:09:23.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2088066830 msgr2=0x7f2088068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2088066830 0x7f2088068cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f209c13a920 tx=0x7f2090008040 comp rx=0 tx=0).stop 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 msgr2=0x7f209c0b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 0x7f209c0b78e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f208c00e9d0 tx=0x7f208c00ed90 comp rx=0 tx=0).stop 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 shutdown_connections 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2088066830 0x7f2088068cf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f209c142520 0x7f209c139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f209c0b0310 0x7f209c1daa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 --2- 172.21.15.94:0/972935421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f209c06cc80 0x7f209c0b78e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 >> 172.21.15.94:0/972935421 conn(0x7f209c06a780 msgr2=0x7f209c1cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 shutdown_connections 2024-03-18T18:09:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f209bfff700 1 -- 172.21.15.94:0/972935421 wait complete. 2024-03-18T18:09:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f12b0066780 msgr2=0x7f12b0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f12b0066780 0x7f12b0068c40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12c40ae180 tx=0x7f12bc001d20 comp rx=0 tx=0).stop 2024-03-18T18:09:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 msgr2=0x7f12c41d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 0x7f12c41d2ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12b800c500 tx=0x7f12b800c810 comp rx=0 tx=0).stop 2024-03-18T18:09:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 shutdown_connections 2024-03-18T18:09:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f12b0066780 0x7f12b0068c40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f12c4147060 0x7f12c41d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12c40b4f00 0x7f12c41d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 --2- 172.21.15.94:0/3414186614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c40b3f80 0x7f12c41d2ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 >> 172.21.15.94:0/3414186614 conn(0x7f12c406a330 msgr2=0x7f12c406a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 shutdown_connections 2024-03-18T18:09:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.928+0000 7f12c91a8700 1 -- 172.21.15.94:0/3414186614 wait complete. 2024-03-18T18:09:23.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.940+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6908005890 con 0x7f6928156200 2024-03-18T18:09:23.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.940+0000 7f690ffff700 1 -- 172.21.15.94:0/459118761 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f691c015090 con 0x7f6928156200 2024-03-18T18:09:23.940 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-03-18T18:09:23.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.5 2024-03-18T18:09:23.942 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6914066780 msgr2=0x7f6914068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6914066780 0x7f6914068c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6918001760 tx=0x7f6918007a50 comp rx=0 tx=0).stop 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 msgr2=0x7f69280a8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 0x7f69280a8980 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f691c00b440 tx=0x7f691c00b750 comp rx=0 tx=0).stop 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 shutdown_connections 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6914066780 0x7f6914068c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6928156200 0x7f69280a8980 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6928155830 0x7f69280a8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 --2- 172.21.15.94:0/459118761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69280b4ab0 0x7f6928070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 >> 172.21.15.94:0/459118761 conn(0x7f692806a330 msgr2=0x7f69280b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 shutdown_connections 2024-03-18T18:09:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:23.944+0000 7f692cbdb700 1 -- 172.21.15.94:0/459118761 wait complete. 2024-03-18T18:09:23.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-03-18T18:09:23.945 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-03-18T18:09:23.954 DEBUG:teuthology.parallel:result is None 2024-03-18T18:09:23.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T18:09:23.954 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:24.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 Processor -- start 2024-03-18T18:09:24.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 -- start start 2024-03-18T18:09:24.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdf8813e210 0x7fdf8813e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf8814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88070560 con 0x7fdf880b13a0 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf880b3790 con 0x7fdf8813e210 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf87fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880b1780 con 0x7fdf8814cbf0 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdf8813e210 0x7fdf8813e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdf8813e210 0x7fdf8813e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35640/0 (socket says 172.21.15.94:35640) 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 -- 172.21.15.94:0/696926336 learned_addr learned my addr 172.21.15.94:0/696926336 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf877fe700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf8814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 -- 172.21.15.94:0/696926336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 msgr2=0x7fdf8814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf8814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 -- 172.21.15.94:0/696926336 >> v1:172.21.15.94:6789/0 conn(0x7fdf880b13a0 legacy=0x7fdf88144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 -- 172.21.15.94:0/696926336 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880b3a30 con 0x7fdf8813e210 2024-03-18T18:09:24.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf877fe700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf8814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.104+0000 7fdf867fc700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf8813e670 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009910 tx=0x7fdf7c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1df69795db8c08 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf85ffb700 1 -- 172.21.15.94:0/696926336 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00ba60 con 0x7fdf8813e210 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf85ffb700 1 -- 172.21.15.94:0/696926336 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00bbc0 con 0x7fdf8813e210 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf85ffb700 1 -- 172.21.15.94:0/696926336 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c009e60 con 0x7fdf8813e210 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- 172.21.15.94:0/696926336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 msgr2=0x7fdf8813e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf8813e670 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009910 tx=0x7fdf7c009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- 172.21.15.94:0/696926336 shutdown_connections 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf8814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 --2- 172.21.15.94:0/696926336 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf8813e670 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- 172.21.15.94:0/696926336 >> 172.21.15.94:0/696926336 conn(0x7fdf880b7a20 msgr2=0x7fdf880b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- 172.21.15.94:0/696926336 shutdown_connections 2024-03-18T18:09:24.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- 172.21.15.94:0/696926336 wait complete. 2024-03-18T18:09:24.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 Processor -- start 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- start start 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880b13a0 0x7fdf881363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf88143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf88142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88072980 con 0x7fdf8813e210 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88072400 con 0x7fdf880b13a0 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf87fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88143ef0 con 0x7fdf8814cbf0 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf88143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf88143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35650/0 (socket says 172.21.15.94:35650) 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 -- 172.21.15.94:0/822127279 learned_addr learned my addr 172.21.15.94:0/822127279 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:24.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf877fe700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf88142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf86ffd700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880b13a0 0x7fdf881363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 -- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 msgr2=0x7fdf88142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf88142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 -- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880b13a0 msgr2=0x7fdf881363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880b13a0 0x7fdf881363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 -- 172.21.15.94:0/822127279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009570 con 0x7fdf8813e210 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf877fe700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf88142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf86ffd700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880b13a0 0x7fdf881363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.108+0000 7fdf867fc700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf88143810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdf880706f0 tx=0x7fdf7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0036c0 con 0x7fdf8813e210 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c01f070 con 0x7fdf8813e210 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf880726a0 con 0x7fdf8813e210 2024-03-18T18:09:24.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c003a20 con 0x7fdf8813e210 2024-03-18T18:09:24.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf88071220 con 0x7fdf8813e210 2024-03-18T18:09:24.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8806fd70 con 0x7fdf8813e210 2024-03-18T18:09:24.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdf7c003b80 con 0x7fdf8813e210 2024-03-18T18:09:24.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.112+0000 7fdf6f7fe700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdf74066760 0x7fdf74068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.116+0000 7fdf86ffd700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdf74066760 0x7fdf74068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.116+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf7c021070 con 0x7fdf8813e210 2024-03-18T18:09:24.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.116+0000 7fdf86ffd700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdf74066760 0x7fdf74068c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf78000f60 tx=0x7fdf78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.120+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdf7c052d70 con 0x7fdf8813e210 2024-03-18T18:09:24.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.268+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf8806f730 con 0x7fdf74066760 2024-03-18T18:09:24.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.280+0000 7fdf6f7fe700 1 -- 172.21.15.94:0/822127279 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7fdf78001c80 con 0x7fdf74066760 2024-03-18T18:09:24.283 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdf74066760 msgr2=0x7fdf74068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdf74066760 0x7fdf74068c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf78000f60 tx=0x7fdf78009040 comp rx=0 tx=0).stop 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 msgr2=0x7fdf88143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf88143810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdf880706f0 tx=0x7fdf7c004770 comp rx=0 tx=0).stop 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 shutdown_connections 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdf74066760 0x7fdf74068c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8814cbf0 0x7fdf88142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf8813e210 0x7fdf88143810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 --2- 172.21.15.94:0/822127279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880b13a0 0x7fdf881363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 >> 172.21.15.94:0/822127279 conn(0x7fdf880b7a20 msgr2=0x7fdf8806e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:24.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 shutdown_connections 2024-03-18T18:09:24.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.284+0000 7fdf87fff700 1 -- 172.21.15.94:0/822127279 wait complete. 2024-03-18T18:09:24.287 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:24.297 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-03-18T18:09:22.562139+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235480,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739240,"statfs":{"total":773094113280,"available":772852981760,"internally_reserved":0,"allocated":2990080,"data_stored":1792404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.752544"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225363+0000","last_change":"2024-03-18T18:09:12.850240+0000","last_active":"2024-03-18T18:09:15.225363+0000","last_peered":"2024-03-18T18:09:15.225363+0000","last_clean":"2024-03-18T18:09:15.225363+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:09:15.225363+0000","last_undegraded":"2024-03-18T18:09:15.225363+0000","last_fullsized":"2024-03-18T18:09:15.225363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823292+0000","last_change":"2024-03-18T18:09:12.829723+0000","last_active":"2024-03-18T18:09:13.823292+0000","last_peered":"2024-03-18T18:09:13.823292+0000","last_clean":"2024-03-18T18:09:13.823292+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:09:13.823292+0000","last_undegraded":"2024-03-18T18:09:13.823292+0000","last_fullsized":"2024-03-18T18:09:13.823292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594203+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:13.594203+0000","last_peered":"2024-03-18T18:09:13.594203+0000","last_clean":"2024-03-18T18:09:13.594203+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:13.594203+0000","last_undegraded":"2024-03-18T18:09:13.594203+0000","last_fullsized":"2024-03-18T18:09:13.594203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825838+0000","last_change":"2024-03-18T18:09:12.846004+0000","last_active":"2024-03-18T18:09:13.825838+0000","last_peered":"2024-03-18T18:09:13.825838+0000","last_clean":"2024-03-18T18:09:13.825838+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:09:13.825838+0000","last_undegraded":"2024-03-18T18:09:13.825838+0000","last_fullsized":"2024-03-18T18:09:13.825838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224681+0000","last_change":"2024-03-18T18:09:12.832618+0000","last_active":"2024-03-18T18:09:15.224681+0000","last_peered":"2024-03-18T18:09:15.224681+0000","last_clean":"2024-03-18T18:09:15.224681+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:09:15.224681+0000","last_undegraded":"2024-03-18T18:09:15.224681+0000","last_fullsized":"2024-03-18T18:09:15.224681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825354+0000","last_change":"2024-03-18T18:09:12.848392+0000","last_active":"2024-03-18T18:09:13.825354+0000","last_peered":"2024-03-18T18:09:13.825354+0000","last_clean":"2024-03-18T18:09:13.825354+0000","last_became_active":"2024-03-18T18:09:12.847328+0000","last_became_peered":"2024-03-18T18:09:12.847328+0000","last_unstale":"2024-03-18T18:09:13.825354+0000","last_undegraded":"2024-03-18T18:09:13.825354+0000","last_fullsized":"2024-03-18T18:09:13.825354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224245+0000","last_change":"2024-03-18T18:09:12.830837+0000","last_active":"2024-03-18T18:09:15.224245+0000","last_peered":"2024-03-18T18:09:15.224245+0000","last_clean":"2024-03-18T18:09:15.224245+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:09:15.224245+0000","last_undegraded":"2024-03-18T18:09:15.224245+0000","last_fullsized":"2024-03-18T18:09:15.224245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591315+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:13.591315+0000","last_peered":"2024-03-18T18:09:13.591315+0000","last_clean":"2024-03-18T18:09:13.591315+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:13.591315+0000","last_undegraded":"2024-03-18T18:09:13.591315+0000","last_fullsized":"2024-03-18T18:09:13.591315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225374+0000","last_change":"2024-03-18T18:09:12.851456+0000","last_active":"2024-03-18T18:09:15.225374+0000","last_peered":"2024-03-18T18:09:15.225374+0000","last_clean":"2024-03-18T18:09:15.225374+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:09:15.225374+0000","last_undegraded":"2024-03-18T18:09:15.225374+0000","last_fullsized":"2024-03-18T18:09:15.225374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824563+0000","last_change":"2024-03-18T18:09:12.843717+0000","last_active":"2024-03-18T18:09:13.824563+0000","last_peered":"2024-03-18T18:09:13.824563+0000","last_clean":"2024-03-18T18:09:13.824563+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:09:13.824563+0000","last_undegraded":"2024-03-18T18:09:13.824563+0000","last_fullsized":"2024-03-18T18:09:13.824563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824325+0000","last_change":"2024-03-18T18:09:12.849907+0000","last_active":"2024-03-18T18:09:13.824325+0000","last_peered":"2024-03-18T18:09:13.824325+0000","last_clean":"2024-03-18T18:09:13.824325+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:09:13.824325+0000","last_undegraded":"2024-03-18T18:09:13.824325+0000","last_fullsized":"2024-03-18T18:09:13.824325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593038+0000","last_change":"2024-03-18T18:09:12.849182+0000","last_active":"2024-03-18T18:09:15.593038+0000","last_peered":"2024-03-18T18:09:15.593038+0000","last_clean":"2024-03-18T18:09:15.593038+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:09:15.593038+0000","last_undegraded":"2024-03-18T18:09:15.593038+0000","last_fullsized":"2024-03-18T18:09:15.593038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591413+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:13.591413+0000","last_peered":"2024-03-18T18:09:13.591413+0000","last_clean":"2024-03-18T18:09:13.591413+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:13.591413+0000","last_undegraded":"2024-03-18T18:09:13.591413+0000","last_fullsized":"2024-03-18T18:09:13.591413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594125+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:13.594125+0000","last_peered":"2024-03-18T18:09:13.594125+0000","last_clean":"2024-03-18T18:09:13.594125+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:13.594125+0000","last_undegraded":"2024-03-18T18:09:13.594125+0000","last_fullsized":"2024-03-18T18:09:13.594125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822920+0000","last_change":"2024-03-18T18:09:12.825991+0000","last_active":"2024-03-18T18:09:13.822920+0000","last_peered":"2024-03-18T18:09:13.822920+0000","last_clean":"2024-03-18T18:09:13.822920+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:09:13.822920+0000","last_undegraded":"2024-03-18T18:09:13.822920+0000","last_fullsized":"2024-03-18T18:09:13.822920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824411+0000","last_change":"2024-03-18T18:09:12.846860+0000","last_active":"2024-03-18T18:09:13.824411+0000","last_peered":"2024-03-18T18:09:13.824411+0000","last_clean":"2024-03-18T18:09:13.824411+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:09:13.824411+0000","last_undegraded":"2024-03-18T18:09:13.824411+0000","last_fullsized":"2024-03-18T18:09:13.824411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825299+0000","last_change":"2024-03-18T18:09:12.843072+0000","last_active":"2024-03-18T18:09:13.825299+0000","last_peered":"2024-03-18T18:09:13.825299+0000","last_clean":"2024-03-18T18:09:13.825299+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:09:13.825299+0000","last_undegraded":"2024-03-18T18:09:13.825299+0000","last_fullsized":"2024-03-18T18:09:13.825299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592609+0000","last_change":"2024-03-18T18:09:12.849294+0000","last_active":"2024-03-18T18:09:14.592609+0000","last_peered":"2024-03-18T18:09:14.592609+0000","last_clean":"2024-03-18T18:09:14.592609+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:09:14.592609+0000","last_undegraded":"2024-03-18T18:09:14.592609+0000","last_fullsized":"2024-03-18T18:09:14.592609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224970+0000","last_change":"2024-03-18T18:09:12.831998+0000","last_active":"2024-03-18T18:09:15.224970+0000","last_peered":"2024-03-18T18:09:15.224970+0000","last_clean":"2024-03-18T18:09:15.224970+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:09:15.224970+0000","last_undegraded":"2024-03-18T18:09:15.224970+0000","last_fullsized":"2024-03-18T18:09:15.224970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824295+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824295+0000","last_peered":"2024-03-18T18:09:13.824295+0000","last_clean":"2024-03-18T18:09:13.824295+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:09:13.824295+0000","last_undegraded":"2024-03-18T18:09:13.824295+0000","last_fullsized":"2024-03-18T18:09:13.824295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594153+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:13.594153+0000","last_peered":"2024-03-18T18:09:13.594153+0000","last_clean":"2024-03-18T18:09:13.594153+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:13.594153+0000","last_undegraded":"2024-03-18T18:09:13.594153+0000","last_fullsized":"2024-03-18T18:09:13.594153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825593+0000","last_change":"2024-03-18T18:09:12.848244+0000","last_active":"2024-03-18T18:09:13.825593+0000","last_peered":"2024-03-18T18:09:13.825593+0000","last_clean":"2024-03-18T18:09:13.825593+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:09:13.825593+0000","last_undegraded":"2024-03-18T18:09:13.825593+0000","last_fullsized":"2024-03-18T18:09:13.825593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591366+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:13.591366+0000","last_peered":"2024-03-18T18:09:13.591366+0000","last_clean":"2024-03-18T18:09:13.591366+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:13.591366+0000","last_undegraded":"2024-03-18T18:09:13.591366+0000","last_fullsized":"2024-03-18T18:09:13.591366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824575+0000","last_change":"2024-03-18T18:09:12.839993+0000","last_active":"2024-03-18T18:09:13.824575+0000","last_peered":"2024-03-18T18:09:13.824575+0000","last_clean":"2024-03-18T18:09:13.824575+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:09:13.824575+0000","last_undegraded":"2024-03-18T18:09:13.824575+0000","last_fullsized":"2024-03-18T18:09:13.824575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591495+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:13.591495+0000","last_peered":"2024-03-18T18:09:13.591495+0000","last_clean":"2024-03-18T18:09:13.591495+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:13.591495+0000","last_undegraded":"2024-03-18T18:09:13.591495+0000","last_fullsized":"2024-03-18T18:09:13.591495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824588+0000","last_change":"2024-03-18T18:09:12.847998+0000","last_active":"2024-03-18T18:09:13.824588+0000","last_peered":"2024-03-18T18:09:13.824588+0000","last_clean":"2024-03-18T18:09:13.824588+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:09:13.824588+0000","last_undegraded":"2024-03-18T18:09:13.824588+0000","last_fullsized":"2024-03-18T18:09:13.824588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823431+0000","last_change":"2024-03-18T18:09:12.825151+0000","last_active":"2024-03-18T18:09:13.823431+0000","last_peered":"2024-03-18T18:09:13.823431+0000","last_clean":"2024-03-18T18:09:13.823431+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:09:13.823431+0000","last_undegraded":"2024-03-18T18:09:13.823431+0000","last_fullsized":"2024-03-18T18:09:13.823431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591453+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:13.591453+0000","last_peered":"2024-03-18T18:09:13.591453+0000","last_clean":"2024-03-18T18:09:13.591453+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:13.591453+0000","last_undegraded":"2024-03-18T18:09:13.591453+0000","last_fullsized":"2024-03-18T18:09:13.591453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594165+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:13.594165+0000","last_peered":"2024-03-18T18:09:13.594165+0000","last_clean":"2024-03-18T18:09:13.594165+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:13.594165+0000","last_undegraded":"2024-03-18T18:09:13.594165+0000","last_fullsized":"2024-03-18T18:09:13.594165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825499+0000","last_change":"2024-03-18T18:09:12.848253+0000","last_active":"2024-03-18T18:09:13.825499+0000","last_peered":"2024-03-18T18:09:13.825499+0000","last_clean":"2024-03-18T18:09:13.825499+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:09:13.825499+0000","last_undegraded":"2024-03-18T18:09:13.825499+0000","last_fullsized":"2024-03-18T18:09:13.825499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592480+0000","last_change":"2024-03-18T18:09:12.843877+0000","last_active":"2024-03-18T18:09:14.592480+0000","last_peered":"2024-03-18T18:09:14.592480+0000","last_clean":"2024-03-18T18:09:14.592480+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:09:14.592480+0000","last_undegraded":"2024-03-18T18:09:14.592480+0000","last_fullsized":"2024-03-18T18:09:14.592480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824113+0000","last_change":"2024-03-18T18:09:12.847460+0000","last_active":"2024-03-18T18:09:13.824113+0000","last_peered":"2024-03-18T18:09:13.824113+0000","last_clean":"2024-03-18T18:09:13.824113+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:09:13.824113+0000","last_undegraded":"2024-03-18T18:09:13.824113+0000","last_fullsized":"2024-03-18T18:09:13.824113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.592990+0000","last_change":"2024-03-18T18:09:12.828461+0000","last_active":"2024-03-18T18:09:15.592990+0000","last_peered":"2024-03-18T18:09:15.592990+0000","last_clean":"2024-03-18T18:09:15.592990+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:09:15.592990+0000","last_undegraded":"2024-03-18T18:09:15.592990+0000","last_fullsized":"2024-03-18T18:09:15.592990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591439+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:13.591439+0000","last_peered":"2024-03-18T18:09:13.591439+0000","last_clean":"2024-03-18T18:09:13.591439+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:13.591439+0000","last_undegraded":"2024-03-18T18:09:13.591439+0000","last_fullsized":"2024-03-18T18:09:13.591439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594176+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:13.594176+0000","last_peered":"2024-03-18T18:09:13.594176+0000","last_clean":"2024-03-18T18:09:13.594176+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:13.594176+0000","last_undegraded":"2024-03-18T18:09:13.594176+0000","last_fullsized":"2024-03-18T18:09:13.594176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824203+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:09:13.824203+0000","last_peered":"2024-03-18T18:09:13.824203+0000","last_clean":"2024-03-18T18:09:13.824203+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:09:13.824203+0000","last_undegraded":"2024-03-18T18:09:13.824203+0000","last_fullsized":"2024-03-18T18:09:13.824203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591378+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:13.591378+0000","last_peered":"2024-03-18T18:09:13.591378+0000","last_clean":"2024-03-18T18:09:13.591378+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:13.591378+0000","last_undegraded":"2024-03-18T18:09:13.591378+0000","last_fullsized":"2024-03-18T18:09:13.591378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591339+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:13.591339+0000","last_peered":"2024-03-18T18:09:13.591339+0000","last_clean":"2024-03-18T18:09:13.591339+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:13.591339+0000","last_undegraded":"2024-03-18T18:09:13.591339+0000","last_fullsized":"2024-03-18T18:09:13.591339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824553+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:09:13.824553+0000","last_peered":"2024-03-18T18:09:13.824553+0000","last_clean":"2024-03-18T18:09:13.824553+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:09:13.824553+0000","last_undegraded":"2024-03-18T18:09:13.824553+0000","last_fullsized":"2024-03-18T18:09:13.824553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822841+0000","last_change":"2024-03-18T18:09:12.824723+0000","last_active":"2024-03-18T18:09:13.822841+0000","last_peered":"2024-03-18T18:09:13.822841+0000","last_clean":"2024-03-18T18:09:13.822841+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:09:13.822841+0000","last_undegraded":"2024-03-18T18:09:13.822841+0000","last_fullsized":"2024-03-18T18:09:13.822841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824781+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:09:13.824781+0000","last_peered":"2024-03-18T18:09:13.824781+0000","last_clean":"2024-03-18T18:09:13.824781+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:09:13.824781+0000","last_undegraded":"2024-03-18T18:09:13.824781+0000","last_fullsized":"2024-03-18T18:09:13.824781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824739+0000","last_change":"2024-03-18T18:09:12.843128+0000","last_active":"2024-03-18T18:09:13.824739+0000","last_peered":"2024-03-18T18:09:13.824739+0000","last_clean":"2024-03-18T18:09:13.824739+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:09:13.824739+0000","last_undegraded":"2024-03-18T18:09:13.824739+0000","last_fullsized":"2024-03-18T18:09:13.824739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824800+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:09:13.824800+0000","last_peered":"2024-03-18T18:09:13.824800+0000","last_clean":"2024-03-18T18:09:13.824800+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:09:13.824800+0000","last_undegraded":"2024-03-18T18:09:13.824800+0000","last_fullsized":"2024-03-18T18:09:13.824800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594244+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:13.594244+0000","last_peered":"2024-03-18T18:09:13.594244+0000","last_clean":"2024-03-18T18:09:13.594244+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:13.594244+0000","last_undegraded":"2024-03-18T18:09:13.594244+0000","last_fullsized":"2024-03-18T18:09:13.594244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823072+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:09:13.823072+0000","last_peered":"2024-03-18T18:09:13.823072+0000","last_clean":"2024-03-18T18:09:13.823072+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:09:13.823072+0000","last_undegraded":"2024-03-18T18:09:13.823072+0000","last_fullsized":"2024-03-18T18:09:13.823072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593069+0000","last_change":"2024-03-18T18:09:12.837565+0000","last_active":"2024-03-18T18:09:15.593069+0000","last_peered":"2024-03-18T18:09:15.593069+0000","last_clean":"2024-03-18T18:09:15.593069+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:09:15.593069+0000","last_undegraded":"2024-03-18T18:09:15.593069+0000","last_fullsized":"2024-03-18T18:09:15.593069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824406+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:09:13.824406+0000","last_peered":"2024-03-18T18:09:13.824406+0000","last_clean":"2024-03-18T18:09:13.824406+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:09:13.824406+0000","last_undegraded":"2024-03-18T18:09:13.824406+0000","last_fullsized":"2024-03-18T18:09:13.824406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224581+0000","last_change":"2024-03-18T18:09:12.830990+0000","last_active":"2024-03-18T18:09:15.224581+0000","last_peered":"2024-03-18T18:09:15.224581+0000","last_clean":"2024-03-18T18:09:15.224581+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:09:15.224581+0000","last_undegraded":"2024-03-18T18:09:15.224581+0000","last_fullsized":"2024-03-18T18:09:15.224581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594189+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:13.594189+0000","last_peered":"2024-03-18T18:09:13.594189+0000","last_clean":"2024-03-18T18:09:13.594189+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:13.594189+0000","last_undegraded":"2024-03-18T18:09:13.594189+0000","last_fullsized":"2024-03-18T18:09:13.594189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594140+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:13.594140+0000","last_peered":"2024-03-18T18:09:13.594140+0000","last_clean":"2024-03-18T18:09:13.594140+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:13.594140+0000","last_undegraded":"2024-03-18T18:09:13.594140+0000","last_fullsized":"2024-03-18T18:09:13.594140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825559+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:09:13.825559+0000","last_peered":"2024-03-18T18:09:13.825559+0000","last_clean":"2024-03-18T18:09:13.825559+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:09:13.825559+0000","last_undegraded":"2024-03-18T18:09:13.825559+0000","last_fullsized":"2024-03-18T18:09:13.825559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224731+0000","last_change":"2024-03-18T18:09:12.839323+0000","last_active":"2024-03-18T18:09:15.224731+0000","last_peered":"2024-03-18T18:09:15.224731+0000","last_clean":"2024-03-18T18:09:15.224731+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:09:15.224731+0000","last_undegraded":"2024-03-18T18:09:15.224731+0000","last_fullsized":"2024-03-18T18:09:15.224731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824196+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:09:13.824196+0000","last_peered":"2024-03-18T18:09:13.824196+0000","last_clean":"2024-03-18T18:09:13.824196+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:09:13.824196+0000","last_undegraded":"2024-03-18T18:09:13.824196+0000","last_fullsized":"2024-03-18T18:09:13.824196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825747+0000","last_change":"2024-03-18T18:09:12.847297+0000","last_active":"2024-03-18T18:09:13.825747+0000","last_peered":"2024-03-18T18:09:13.825747+0000","last_clean":"2024-03-18T18:09:13.825747+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:09:13.825747+0000","last_undegraded":"2024-03-18T18:09:13.825747+0000","last_fullsized":"2024-03-18T18:09:13.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592391+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:09:14.592391+0000","last_peered":"2024-03-18T18:09:14.592391+0000","last_clean":"2024-03-18T18:09:14.592391+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:09:14.592391+0000","last_undegraded":"2024-03-18T18:09:14.592391+0000","last_fullsized":"2024-03-18T18:09:14.592391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224387+0000","last_change":"2024-03-18T18:09:12.838637+0000","last_active":"2024-03-18T18:09:15.224387+0000","last_peered":"2024-03-18T18:09:15.224387+0000","last_clean":"2024-03-18T18:09:15.224387+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:09:15.224387+0000","last_undegraded":"2024-03-18T18:09:15.224387+0000","last_fullsized":"2024-03-18T18:09:15.224387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593097+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:09:15.593097+0000","last_peered":"2024-03-18T18:09:15.593097+0000","last_clean":"2024-03-18T18:09:15.593097+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:09:15.593097+0000","last_undegraded":"2024-03-18T18:09:15.593097+0000","last_fullsized":"2024-03-18T18:09:15.593097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225074+0000","last_change":"2024-03-18T18:09:12.838775+0000","last_active":"2024-03-18T18:09:15.225074+0000","last_peered":"2024-03-18T18:09:15.225074+0000","last_clean":"2024-03-18T18:09:15.225074+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:09:15.225074+0000","last_undegraded":"2024-03-18T18:09:15.225074+0000","last_fullsized":"2024-03-18T18:09:15.225074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592654+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:09:14.592654+0000","last_peered":"2024-03-18T18:09:14.592654+0000","last_clean":"2024-03-18T18:09:14.592654+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:09:14.592654+0000","last_undegraded":"2024-03-18T18:09:14.592654+0000","last_fullsized":"2024-03-18T18:09:14.592654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225593+0000","last_change":"2024-03-18T18:09:12.841196+0000","last_active":"2024-03-18T18:09:15.225593+0000","last_peered":"2024-03-18T18:09:15.225593+0000","last_clean":"2024-03-18T18:09:15.225593+0000","last_became_active":"2024-03-18T18:09:12.840659+0000","last_became_peered":"2024-03-18T18:09:12.840659+0000","last_unstale":"2024-03-18T18:09:15.225593+0000","last_undegraded":"2024-03-18T18:09:15.225593+0000","last_fullsized":"2024-03-18T18:09:15.225593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823141+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:09:13.823141+0000","last_peered":"2024-03-18T18:09:13.823141+0000","last_clean":"2024-03-18T18:09:13.823141+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:09:13.823141+0000","last_undegraded":"2024-03-18T18:09:13.823141+0000","last_fullsized":"2024-03-18T18:09:13.823141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825348+0000","last_change":"2024-03-18T18:09:12.834479+0000","last_active":"2024-03-18T18:09:13.825348+0000","last_peered":"2024-03-18T18:09:13.825348+0000","last_clean":"2024-03-18T18:09:13.825348+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:09:13.825348+0000","last_undegraded":"2024-03-18T18:09:13.825348+0000","last_fullsized":"2024-03-18T18:09:13.825348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592567+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:09:14.592567+0000","last_peered":"2024-03-18T18:09:14.592567+0000","last_clean":"2024-03-18T18:09:14.592567+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:09:14.592567+0000","last_undegraded":"2024-03-18T18:09:14.592567+0000","last_fullsized":"2024-03-18T18:09:14.592567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224685+0000","last_change":"2024-03-18T18:09:12.845096+0000","last_active":"2024-03-18T18:09:15.224685+0000","last_peered":"2024-03-18T18:09:15.224685+0000","last_clean":"2024-03-18T18:09:15.224685+0000","last_became_active":"2024-03-18T18:09:12.844794+0000","last_became_peered":"2024-03-18T18:09:12.844794+0000","last_unstale":"2024-03-18T18:09:15.224685+0000","last_undegraded":"2024-03-18T18:09:15.224685+0000","last_fullsized":"2024-03-18T18:09:15.224685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:47.908637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.822307+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:12.822307+0000","last_peered":"2024-03-18T18:09:12.822307+0000","last_clean":"2024-03-18T18:09:12.822307+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:12.822307+0000","last_undegraded":"2024-03-18T18:09:12.822307+0000","last_fullsized":"2024-03-18T18:09:12.822307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824253+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:09:13.824253+0000","last_peered":"2024-03-18T18:09:13.824253+0000","last_clean":"2024-03-18T18:09:13.824253+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:09:13.824253+0000","last_undegraded":"2024-03-18T18:09:13.824253+0000","last_fullsized":"2024-03-18T18:09:13.824253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591391+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:13.591391+0000","last_peered":"2024-03-18T18:09:13.591391+0000","last_clean":"2024-03-18T18:09:13.591391+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:13.591391+0000","last_undegraded":"2024-03-18T18:09:13.591391+0000","last_fullsized":"2024-03-18T18:09:13.591391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224061+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:09:15.224061+0000","last_peered":"2024-03-18T18:09:15.224061+0000","last_clean":"2024-03-18T18:09:15.224061+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:09:15.224061+0000","last_undegraded":"2024-03-18T18:09:15.224061+0000","last_fullsized":"2024-03-18T18:09:15.224061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594096+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:13.594096+0000","last_peered":"2024-03-18T18:09:13.594096+0000","last_clean":"2024-03-18T18:09:13.594096+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:13.594096+0000","last_undegraded":"2024-03-18T18:09:13.594096+0000","last_fullsized":"2024-03-18T18:09:13.594096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592521+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:09:14.592521+0000","last_peered":"2024-03-18T18:09:14.592521+0000","last_clean":"2024-03-18T18:09:14.592521+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:09:14.592521+0000","last_undegraded":"2024-03-18T18:09:14.592521+0000","last_fullsized":"2024-03-18T18:09:14.592521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822734+0000","last_change":"2024-03-18T18:09:12.822692+0000","last_active":"2024-03-18T18:09:13.822734+0000","last_peered":"2024-03-18T18:09:13.822734+0000","last_clean":"2024-03-18T18:09:13.822734+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:09:13.822734+0000","last_undegraded":"2024-03-18T18:09:13.822734+0000","last_fullsized":"2024-03-18T18:09:13.822734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825607+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:09:13.825607+0000","last_peered":"2024-03-18T18:09:13.825607+0000","last_clean":"2024-03-18T18:09:13.825607+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:09:13.825607+0000","last_undegraded":"2024-03-18T18:09:13.825607+0000","last_fullsized":"2024-03-18T18:09:13.825607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593014+0000","last_change":"2024-03-18T18:09:12.835734+0000","last_active":"2024-03-18T18:09:15.593014+0000","last_peered":"2024-03-18T18:09:15.593014+0000","last_clean":"2024-03-18T18:09:15.593014+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:09:15.593014+0000","last_undegraded":"2024-03-18T18:09:15.593014+0000","last_fullsized":"2024-03-18T18:09:15.593014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822995+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:09:13.822995+0000","last_peered":"2024-03-18T18:09:13.822995+0000","last_clean":"2024-03-18T18:09:13.822995+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:09:13.822995+0000","last_undegraded":"2024-03-18T18:09:13.822995+0000","last_fullsized":"2024-03-18T18:09:13.822995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824964+0000","last_change":"2024-03-18T18:09:12.842890+0000","last_active":"2024-03-18T18:09:13.824964+0000","last_peered":"2024-03-18T18:09:13.824964+0000","last_clean":"2024-03-18T18:09:13.824964+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:09:13.824964+0000","last_undegraded":"2024-03-18T18:09:13.824964+0000","last_fullsized":"2024-03-18T18:09:13.824964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225099+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:09:15.225099+0000","last_peered":"2024-03-18T18:09:15.225099+0000","last_clean":"2024-03-18T18:09:15.225099+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:09:15.225099+0000","last_undegraded":"2024-03-18T18:09:15.225099+0000","last_fullsized":"2024-03-18T18:09:15.225099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822874+0000","last_change":"2024-03-18T18:09:12.821957+0000","last_active":"2024-03-18T18:09:13.822874+0000","last_peered":"2024-03-18T18:09:13.822874+0000","last_clean":"2024-03-18T18:09:13.822874+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:09:13.822874+0000","last_undegraded":"2024-03-18T18:09:13.822874+0000","last_fullsized":"2024-03-18T18:09:13.822874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592881+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:09:14.592881+0000","last_peered":"2024-03-18T18:09:14.592881+0000","last_clean":"2024-03-18T18:09:14.592881+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:09:14.592881+0000","last_undegraded":"2024-03-18T18:09:14.592881+0000","last_fullsized":"2024-03-18T18:09:14.592881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591506+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:13.591506+0000","last_peered":"2024-03-18T18:09:13.591506+0000","last_clean":"2024-03-18T18:09:13.591506+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:13.591506+0000","last_undegraded":"2024-03-18T18:09:13.591506+0000","last_fullsized":"2024-03-18T18:09:13.591506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824875+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:09:13.824875+0000","last_peered":"2024-03-18T18:09:13.824875+0000","last_clean":"2024-03-18T18:09:13.824875+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:09:13.824875+0000","last_undegraded":"2024-03-18T18:09:13.824875+0000","last_fullsized":"2024-03-18T18:09:13.824875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594215+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:13.594215+0000","last_peered":"2024-03-18T18:09:13.594215+0000","last_clean":"2024-03-18T18:09:13.594215+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:13.594215+0000","last_undegraded":"2024-03-18T18:09:13.594215+0000","last_fullsized":"2024-03-18T18:09:13.594215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224023+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:09:15.224023+0000","last_peered":"2024-03-18T18:09:15.224023+0000","last_clean":"2024-03-18T18:09:15.224023+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:09:15.224023+0000","last_undegraded":"2024-03-18T18:09:15.224023+0000","last_fullsized":"2024-03-18T18:09:15.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.592954+0000","last_change":"2024-03-18T18:09:12.824858+0000","last_active":"2024-03-18T18:09:15.592954+0000","last_peered":"2024-03-18T18:09:15.592954+0000","last_clean":"2024-03-18T18:09:15.592954+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:09:15.592954+0000","last_undegraded":"2024-03-18T18:09:15.592954+0000","last_fullsized":"2024-03-18T18:09:15.592954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823079+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:09:13.823079+0000","last_peered":"2024-03-18T18:09:13.823079+0000","last_clean":"2024-03-18T18:09:13.823079+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:09:13.823079+0000","last_undegraded":"2024-03-18T18:09:13.823079+0000","last_fullsized":"2024-03-18T18:09:13.823079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591353+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:13.591353+0000","last_peered":"2024-03-18T18:09:13.591353+0000","last_clean":"2024-03-18T18:09:13.591353+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:13.591353+0000","last_undegraded":"2024-03-18T18:09:13.591353+0000","last_fullsized":"2024-03-18T18:09:13.591353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823186+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:09:13.823186+0000","last_peered":"2024-03-18T18:09:13.823186+0000","last_clean":"2024-03-18T18:09:13.823186+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:09:13.823186+0000","last_undegraded":"2024-03-18T18:09:13.823186+0000","last_fullsized":"2024-03-18T18:09:13.823186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591425+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:13.591425+0000","last_peered":"2024-03-18T18:09:13.591425+0000","last_clean":"2024-03-18T18:09:13.591425+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:13.591425+0000","last_undegraded":"2024-03-18T18:09:13.591425+0000","last_fullsized":"2024-03-18T18:09:13.591425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224945+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:09:15.224945+0000","last_peered":"2024-03-18T18:09:15.224945+0000","last_clean":"2024-03-18T18:09:15.224945+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:09:15.224945+0000","last_undegraded":"2024-03-18T18:09:15.224945+0000","last_fullsized":"2024-03-18T18:09:15.224945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824060+0000","last_change":"2024-03-18T18:09:12.842987+0000","last_active":"2024-03-18T18:09:13.824060+0000","last_peered":"2024-03-18T18:09:13.824060+0000","last_clean":"2024-03-18T18:09:13.824060+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:09:13.824060+0000","last_undegraded":"2024-03-18T18:09:13.824060+0000","last_fullsized":"2024-03-18T18:09:13.824060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824811+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824811+0000","last_peered":"2024-03-18T18:09:13.824811+0000","last_clean":"2024-03-18T18:09:13.824811+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:09:13.824811+0000","last_undegraded":"2024-03-18T18:09:13.824811+0000","last_fullsized":"2024-03-18T18:09:13.824811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224645+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:09:15.224645+0000","last_peered":"2024-03-18T18:09:15.224645+0000","last_clean":"2024-03-18T18:09:15.224645+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:09:15.224645+0000","last_undegraded":"2024-03-18T18:09:15.224645+0000","last_fullsized":"2024-03-18T18:09:15.224645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825111+0000","last_change":"2024-03-18T18:09:12.849269+0000","last_active":"2024-03-18T18:09:13.825111+0000","last_peered":"2024-03-18T18:09:13.825111+0000","last_clean":"2024-03-18T18:09:13.825111+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:09:13.825111+0000","last_undegraded":"2024-03-18T18:09:13.825111+0000","last_fullsized":"2024-03-18T18:09:13.825111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224838+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:09:15.224838+0000","last_peered":"2024-03-18T18:09:15.224838+0000","last_clean":"2024-03-18T18:09:15.224838+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:09:15.224838+0000","last_undegraded":"2024-03-18T18:09:15.224838+0000","last_fullsized":"2024-03-18T18:09:15.224838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594228+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:13.594228+0000","last_peered":"2024-03-18T18:09:13.594228+0000","last_clean":"2024-03-18T18:09:13.594228+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:13.594228+0000","last_undegraded":"2024-03-18T18:09:13.594228+0000","last_fullsized":"2024-03-18T18:09:13.594228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591482+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:13.591482+0000","last_peered":"2024-03-18T18:09:13.591482+0000","last_clean":"2024-03-18T18:09:13.591482+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:13.591482+0000","last_undegraded":"2024-03-18T18:09:13.591482+0000","last_fullsized":"2024-03-18T18:09:13.591482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591469+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:13.591469+0000","last_peered":"2024-03-18T18:09:13.591469+0000","last_clean":"2024-03-18T18:09:13.591469+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:13.591469+0000","last_undegraded":"2024-03-18T18:09:13.591469+0000","last_fullsized":"2024-03-18T18:09:13.591469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594270+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:13.594270+0000","last_peered":"2024-03-18T18:09:13.594270+0000","last_clean":"2024-03-18T18:09:13.594270+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:13.594270+0000","last_undegraded":"2024-03-18T18:09:13.594270+0000","last_fullsized":"2024-03-18T18:09:13.594270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.736}]}]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":75868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":225280,"data_stored":76028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":229376,"data_stored":77432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":823296,"data_stored":666874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:24.301 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:09:24.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 Processor -- start 2024-03-18T18:09:24.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- start start 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e100b13a0 0x7f4e10144300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4e1014cbf0 0x7f4e1014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e10070560 con 0x7f4e10144840 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100b3790 con 0x7f4e1014cbf0 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b1780 con 0x7f4e100b13a0 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0ffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4e1014cbf0 0x7f4e1014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0effd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4e10144840 0x7f4e1013e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39726/0 (socket says 172.21.15.94:39726) 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0effd700 1 -- 172.21.15.94:0/2556481865 learned_addr learned my addr 172.21.15.94:0/2556481865 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0f7fe700 1 --2- 172.21.15.94:0/2556481865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e100b13a0 0x7f4e10144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0ffff700 1 -- 172.21.15.94:0/2556481865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e100b13a0 msgr2=0x7f4e10144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:24.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0ffff700 1 --2- 172.21.15.94:0/2556481865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e100b13a0 0x7f4e10144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0ffff700 1 -- 172.21.15.94:0/2556481865 >> v1:172.21.15.94:6789/0 conn(0x7f4e10144840 legacy=0x7f4e1013e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0ffff700 1 -- 172.21.15.94:0/2556481865 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100b3a30 con 0x7f4e1014cbf0 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0e7fc700 1 -- 172.21.15.94:0/2556481865 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894076211 0 0) 0x7f4e10070560 con 0x7f4e10144840 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0ffff700 1 --2- 172.21.15.94:0/2556481865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e1014efe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009d90 tx=0x7f4e0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cd972fabce5ea4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0e7fc700 1 -- 172.21.15.94:0/2556481865 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800e070 con 0x7f4e1014cbf0 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0e7fc700 1 -- 172.21.15.94:0/2556481865 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0800bbd0 con 0x7f4e1014cbf0 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e0e7fc700 1 -- 172.21.15.94:0/2556481865 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012430 con 0x7f4e1014cbf0 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- 172.21.15.94:0/2556481865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 msgr2=0x7f4e1014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 --2- 172.21.15.94:0/2556481865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e1014efe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009d90 tx=0x7f4e0800b330 comp rx=0 tx=0).stop 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- 172.21.15.94:0/2556481865 shutdown_connections 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 --2- 172.21.15.94:0/2556481865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e1014efe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 --2- 172.21.15.94:0/2556481865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e100b13a0 0x7f4e10144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- 172.21.15.94:0/2556481865 >> 172.21.15.94:0/2556481865 conn(0x7f4e100b7a20 msgr2=0x7f4e100b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:24.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- 172.21.15.94:0/2556481865 shutdown_connections 2024-03-18T18:09:24.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.408+0000 7f4e148a9700 1 -- 172.21.15.94:0/2556481865 wait complete. 2024-03-18T18:09:24.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.412+0000 7f4e148a9700 1 Processor -- start 2024-03-18T18:09:24.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.412+0000 7f4e148a9700 1 -- start start 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.412+0000 7f4e148a9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e100b13a0 0x7f4e1013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.412+0000 7f4e148a9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e10144840 0x7f4e101402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e10133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101dde30 con 0x7f4e1014cbf0 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1013f6a0 con 0x7f4e100b13a0 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10142170 con 0x7f4e10144840 2024-03-18T18:09:24.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e10133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e10133990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60876/0 (socket says 172.21.15.94:60876) 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 -- 172.21.15.94:0/1526023210 learned_addr learned my addr 172.21.15.94:0/1526023210 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0f7fe700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e100b13a0 0x7f4e1013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0effd700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e10144840 0x7f4e101402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 -- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e10144840 msgr2=0x7f4e101402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e10144840 0x7f4e101402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 -- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e100b13a0 msgr2=0x7f4e1013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e100b13a0 0x7f4e1013fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 -- 172.21.15.94:0/1526023210 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009a70 con 0x7f4e1014cbf0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0effd700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e10144840 0x7f4e101402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0ffff700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e10133990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e08013000 tx=0x7f4e08004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08012430 con 0x7f4e1014cbf0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08020070 con 0x7f4e1014cbf0 2024-03-18T18:09:24.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1013f910 con 0x7f4e1014cbf0 2024-03-18T18:09:24.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08004280 con 0x7f4e1014cbf0 2024-03-18T18:09:24.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1013cf80 con 0x7f4e1014cbf0 2024-03-18T18:09:24.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1006fd70 con 0x7f4e1014cbf0 2024-03-18T18:09:24.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4e080043e0 con 0x7f4e1014cbf0 2024-03-18T18:09:24.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e07fff700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4df0066730 0x7f4df0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e08022070 con 0x7f4e1014cbf0 2024-03-18T18:09:24.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0f7fe700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4df0066730 0x7f4df0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.416+0000 7f4e0f7fe700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4df0066730 0x7f4df0068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e10142390 tx=0x7f4e00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.424+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4e08053a70 con 0x7f4e1014cbf0 2024-03-18T18:09:24.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.580+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e1006f210 con 0x7f4df0066730 2024-03-18T18:09:24.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.584+0000 7f4e07fff700 1 -- 172.21.15.94:0/1526023210 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264538 (secure 0 0 0) 0x7f4e00009df0 con 0x7f4df0066730 2024-03-18T18:09:24.590 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:24.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4df0066730 msgr2=0x7f4df0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4df0066730 0x7f4df0068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e10142390 tx=0x7f4e00008040 comp rx=0 tx=0).stop 2024-03-18T18:09:24.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 msgr2=0x7f4e10133990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e10133990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e08013000 tx=0x7f4e08004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 shutdown_connections 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4df0066730 0x7f4df0068bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4e1014cbf0 0x7f4e10133990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e10144840 0x7f4e101402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 --2- 172.21.15.94:0/1526023210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e100b13a0 0x7f4e1013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 >> 172.21.15.94:0/1526023210 conn(0x7f4e100b7a20 msgr2=0x7f4e100b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 shutdown_connections 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.592+0000 7f4e148a9700 1 -- 172.21.15.94:0/1526023210 wait complete. 2024-03-18T18:09:24.593 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:09:24.604 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-03-18T18:09:24.563055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235480,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739240,"statfs":{"total":773094113280,"available":772852981760,"internally_reserved":0,"allocated":2990080,"data_stored":1792404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":238014012},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1746,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.743242"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225363+0000","last_change":"2024-03-18T18:09:12.850240+0000","last_active":"2024-03-18T18:09:15.225363+0000","last_peered":"2024-03-18T18:09:15.225363+0000","last_clean":"2024-03-18T18:09:15.225363+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:09:15.225363+0000","last_undegraded":"2024-03-18T18:09:15.225363+0000","last_fullsized":"2024-03-18T18:09:15.225363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823292+0000","last_change":"2024-03-18T18:09:12.829723+0000","last_active":"2024-03-18T18:09:13.823292+0000","last_peered":"2024-03-18T18:09:13.823292+0000","last_clean":"2024-03-18T18:09:13.823292+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:09:13.823292+0000","last_undegraded":"2024-03-18T18:09:13.823292+0000","last_fullsized":"2024-03-18T18:09:13.823292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594203+0000","last_change":"2024-03-18T18:09:12.831470+0000","last_active":"2024-03-18T18:09:13.594203+0000","last_peered":"2024-03-18T18:09:13.594203+0000","last_clean":"2024-03-18T18:09:13.594203+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:09:13.594203+0000","last_undegraded":"2024-03-18T18:09:13.594203+0000","last_fullsized":"2024-03-18T18:09:13.594203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825838+0000","last_change":"2024-03-18T18:09:12.846004+0000","last_active":"2024-03-18T18:09:13.825838+0000","last_peered":"2024-03-18T18:09:13.825838+0000","last_clean":"2024-03-18T18:09:13.825838+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:09:13.825838+0000","last_undegraded":"2024-03-18T18:09:13.825838+0000","last_fullsized":"2024-03-18T18:09:13.825838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224681+0000","last_change":"2024-03-18T18:09:12.832618+0000","last_active":"2024-03-18T18:09:15.224681+0000","last_peered":"2024-03-18T18:09:15.224681+0000","last_clean":"2024-03-18T18:09:15.224681+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:09:15.224681+0000","last_undegraded":"2024-03-18T18:09:15.224681+0000","last_fullsized":"2024-03-18T18:09:15.224681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825354+0000","last_change":"2024-03-18T18:09:12.848392+0000","last_active":"2024-03-18T18:09:13.825354+0000","last_peered":"2024-03-18T18:09:13.825354+0000","last_clean":"2024-03-18T18:09:13.825354+0000","last_became_active":"2024-03-18T18:09:12.847328+0000","last_became_peered":"2024-03-18T18:09:12.847328+0000","last_unstale":"2024-03-18T18:09:13.825354+0000","last_undegraded":"2024-03-18T18:09:13.825354+0000","last_fullsized":"2024-03-18T18:09:13.825354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224245+0000","last_change":"2024-03-18T18:09:12.830837+0000","last_active":"2024-03-18T18:09:15.224245+0000","last_peered":"2024-03-18T18:09:15.224245+0000","last_clean":"2024-03-18T18:09:15.224245+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:09:15.224245+0000","last_undegraded":"2024-03-18T18:09:15.224245+0000","last_fullsized":"2024-03-18T18:09:15.224245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591315+0000","last_change":"2024-03-18T18:09:12.845223+0000","last_active":"2024-03-18T18:09:13.591315+0000","last_peered":"2024-03-18T18:09:13.591315+0000","last_clean":"2024-03-18T18:09:13.591315+0000","last_became_active":"2024-03-18T18:09:12.844892+0000","last_became_peered":"2024-03-18T18:09:12.844892+0000","last_unstale":"2024-03-18T18:09:13.591315+0000","last_undegraded":"2024-03-18T18:09:13.591315+0000","last_fullsized":"2024-03-18T18:09:13.591315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225374+0000","last_change":"2024-03-18T18:09:12.851456+0000","last_active":"2024-03-18T18:09:15.225374+0000","last_peered":"2024-03-18T18:09:15.225374+0000","last_clean":"2024-03-18T18:09:15.225374+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:09:15.225374+0000","last_undegraded":"2024-03-18T18:09:15.225374+0000","last_fullsized":"2024-03-18T18:09:15.225374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824563+0000","last_change":"2024-03-18T18:09:12.843717+0000","last_active":"2024-03-18T18:09:13.824563+0000","last_peered":"2024-03-18T18:09:13.824563+0000","last_clean":"2024-03-18T18:09:13.824563+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:09:13.824563+0000","last_undegraded":"2024-03-18T18:09:13.824563+0000","last_fullsized":"2024-03-18T18:09:13.824563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824325+0000","last_change":"2024-03-18T18:09:12.849907+0000","last_active":"2024-03-18T18:09:13.824325+0000","last_peered":"2024-03-18T18:09:13.824325+0000","last_clean":"2024-03-18T18:09:13.824325+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:09:13.824325+0000","last_undegraded":"2024-03-18T18:09:13.824325+0000","last_fullsized":"2024-03-18T18:09:13.824325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593038+0000","last_change":"2024-03-18T18:09:12.849182+0000","last_active":"2024-03-18T18:09:15.593038+0000","last_peered":"2024-03-18T18:09:15.593038+0000","last_clean":"2024-03-18T18:09:15.593038+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:09:15.593038+0000","last_undegraded":"2024-03-18T18:09:15.593038+0000","last_fullsized":"2024-03-18T18:09:15.593038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591413+0000","last_change":"2024-03-18T18:09:12.848926+0000","last_active":"2024-03-18T18:09:13.591413+0000","last_peered":"2024-03-18T18:09:13.591413+0000","last_clean":"2024-03-18T18:09:13.591413+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:09:13.591413+0000","last_undegraded":"2024-03-18T18:09:13.591413+0000","last_fullsized":"2024-03-18T18:09:13.591413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594125+0000","last_change":"2024-03-18T18:09:12.834553+0000","last_active":"2024-03-18T18:09:13.594125+0000","last_peered":"2024-03-18T18:09:13.594125+0000","last_clean":"2024-03-18T18:09:13.594125+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:09:13.594125+0000","last_undegraded":"2024-03-18T18:09:13.594125+0000","last_fullsized":"2024-03-18T18:09:13.594125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822920+0000","last_change":"2024-03-18T18:09:12.825991+0000","last_active":"2024-03-18T18:09:13.822920+0000","last_peered":"2024-03-18T18:09:13.822920+0000","last_clean":"2024-03-18T18:09:13.822920+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:09:13.822920+0000","last_undegraded":"2024-03-18T18:09:13.822920+0000","last_fullsized":"2024-03-18T18:09:13.822920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824411+0000","last_change":"2024-03-18T18:09:12.846860+0000","last_active":"2024-03-18T18:09:13.824411+0000","last_peered":"2024-03-18T18:09:13.824411+0000","last_clean":"2024-03-18T18:09:13.824411+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:09:13.824411+0000","last_undegraded":"2024-03-18T18:09:13.824411+0000","last_fullsized":"2024-03-18T18:09:13.824411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825299+0000","last_change":"2024-03-18T18:09:12.843072+0000","last_active":"2024-03-18T18:09:13.825299+0000","last_peered":"2024-03-18T18:09:13.825299+0000","last_clean":"2024-03-18T18:09:13.825299+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:09:13.825299+0000","last_undegraded":"2024-03-18T18:09:13.825299+0000","last_fullsized":"2024-03-18T18:09:13.825299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592609+0000","last_change":"2024-03-18T18:09:12.849294+0000","last_active":"2024-03-18T18:09:14.592609+0000","last_peered":"2024-03-18T18:09:14.592609+0000","last_clean":"2024-03-18T18:09:14.592609+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:09:14.592609+0000","last_undegraded":"2024-03-18T18:09:14.592609+0000","last_fullsized":"2024-03-18T18:09:14.592609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224970+0000","last_change":"2024-03-18T18:09:12.831998+0000","last_active":"2024-03-18T18:09:15.224970+0000","last_peered":"2024-03-18T18:09:15.224970+0000","last_clean":"2024-03-18T18:09:15.224970+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:09:15.224970+0000","last_undegraded":"2024-03-18T18:09:15.224970+0000","last_fullsized":"2024-03-18T18:09:15.224970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824295+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824295+0000","last_peered":"2024-03-18T18:09:13.824295+0000","last_clean":"2024-03-18T18:09:13.824295+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:09:13.824295+0000","last_undegraded":"2024-03-18T18:09:13.824295+0000","last_fullsized":"2024-03-18T18:09:13.824295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594153+0000","last_change":"2024-03-18T18:09:12.835132+0000","last_active":"2024-03-18T18:09:13.594153+0000","last_peered":"2024-03-18T18:09:13.594153+0000","last_clean":"2024-03-18T18:09:13.594153+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:09:13.594153+0000","last_undegraded":"2024-03-18T18:09:13.594153+0000","last_fullsized":"2024-03-18T18:09:13.594153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825593+0000","last_change":"2024-03-18T18:09:12.848244+0000","last_active":"2024-03-18T18:09:13.825593+0000","last_peered":"2024-03-18T18:09:13.825593+0000","last_clean":"2024-03-18T18:09:13.825593+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:09:13.825593+0000","last_undegraded":"2024-03-18T18:09:13.825593+0000","last_fullsized":"2024-03-18T18:09:13.825593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591366+0000","last_change":"2024-03-18T18:09:12.827462+0000","last_active":"2024-03-18T18:09:13.591366+0000","last_peered":"2024-03-18T18:09:13.591366+0000","last_clean":"2024-03-18T18:09:13.591366+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:09:13.591366+0000","last_undegraded":"2024-03-18T18:09:13.591366+0000","last_fullsized":"2024-03-18T18:09:13.591366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824575+0000","last_change":"2024-03-18T18:09:12.839993+0000","last_active":"2024-03-18T18:09:13.824575+0000","last_peered":"2024-03-18T18:09:13.824575+0000","last_clean":"2024-03-18T18:09:13.824575+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:09:13.824575+0000","last_undegraded":"2024-03-18T18:09:13.824575+0000","last_fullsized":"2024-03-18T18:09:13.824575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591495+0000","last_change":"2024-03-18T18:09:12.827657+0000","last_active":"2024-03-18T18:09:13.591495+0000","last_peered":"2024-03-18T18:09:13.591495+0000","last_clean":"2024-03-18T18:09:13.591495+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:09:13.591495+0000","last_undegraded":"2024-03-18T18:09:13.591495+0000","last_fullsized":"2024-03-18T18:09:13.591495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824588+0000","last_change":"2024-03-18T18:09:12.847998+0000","last_active":"2024-03-18T18:09:13.824588+0000","last_peered":"2024-03-18T18:09:13.824588+0000","last_clean":"2024-03-18T18:09:13.824588+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:09:13.824588+0000","last_undegraded":"2024-03-18T18:09:13.824588+0000","last_fullsized":"2024-03-18T18:09:13.824588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823431+0000","last_change":"2024-03-18T18:09:12.825151+0000","last_active":"2024-03-18T18:09:13.823431+0000","last_peered":"2024-03-18T18:09:13.823431+0000","last_clean":"2024-03-18T18:09:13.823431+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:09:13.823431+0000","last_undegraded":"2024-03-18T18:09:13.823431+0000","last_fullsized":"2024-03-18T18:09:13.823431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591453+0000","last_change":"2024-03-18T18:09:12.827012+0000","last_active":"2024-03-18T18:09:13.591453+0000","last_peered":"2024-03-18T18:09:13.591453+0000","last_clean":"2024-03-18T18:09:13.591453+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:09:13.591453+0000","last_undegraded":"2024-03-18T18:09:13.591453+0000","last_fullsized":"2024-03-18T18:09:13.591453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594165+0000","last_change":"2024-03-18T18:09:12.834557+0000","last_active":"2024-03-18T18:09:13.594165+0000","last_peered":"2024-03-18T18:09:13.594165+0000","last_clean":"2024-03-18T18:09:13.594165+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:09:13.594165+0000","last_undegraded":"2024-03-18T18:09:13.594165+0000","last_fullsized":"2024-03-18T18:09:13.594165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825499+0000","last_change":"2024-03-18T18:09:12.848253+0000","last_active":"2024-03-18T18:09:13.825499+0000","last_peered":"2024-03-18T18:09:13.825499+0000","last_clean":"2024-03-18T18:09:13.825499+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:09:13.825499+0000","last_undegraded":"2024-03-18T18:09:13.825499+0000","last_fullsized":"2024-03-18T18:09:13.825499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592480+0000","last_change":"2024-03-18T18:09:12.843877+0000","last_active":"2024-03-18T18:09:14.592480+0000","last_peered":"2024-03-18T18:09:14.592480+0000","last_clean":"2024-03-18T18:09:14.592480+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:09:14.592480+0000","last_undegraded":"2024-03-18T18:09:14.592480+0000","last_fullsized":"2024-03-18T18:09:14.592480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824113+0000","last_change":"2024-03-18T18:09:12.847460+0000","last_active":"2024-03-18T18:09:13.824113+0000","last_peered":"2024-03-18T18:09:13.824113+0000","last_clean":"2024-03-18T18:09:13.824113+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:09:13.824113+0000","last_undegraded":"2024-03-18T18:09:13.824113+0000","last_fullsized":"2024-03-18T18:09:13.824113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.592990+0000","last_change":"2024-03-18T18:09:12.828461+0000","last_active":"2024-03-18T18:09:15.592990+0000","last_peered":"2024-03-18T18:09:15.592990+0000","last_clean":"2024-03-18T18:09:15.592990+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:09:15.592990+0000","last_undegraded":"2024-03-18T18:09:15.592990+0000","last_fullsized":"2024-03-18T18:09:15.592990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591439+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:09:13.591439+0000","last_peered":"2024-03-18T18:09:13.591439+0000","last_clean":"2024-03-18T18:09:13.591439+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:09:13.591439+0000","last_undegraded":"2024-03-18T18:09:13.591439+0000","last_fullsized":"2024-03-18T18:09:13.591439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594176+0000","last_change":"2024-03-18T18:09:12.839238+0000","last_active":"2024-03-18T18:09:13.594176+0000","last_peered":"2024-03-18T18:09:13.594176+0000","last_clean":"2024-03-18T18:09:13.594176+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:09:13.594176+0000","last_undegraded":"2024-03-18T18:09:13.594176+0000","last_fullsized":"2024-03-18T18:09:13.594176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824203+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:09:13.824203+0000","last_peered":"2024-03-18T18:09:13.824203+0000","last_clean":"2024-03-18T18:09:13.824203+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:09:13.824203+0000","last_undegraded":"2024-03-18T18:09:13.824203+0000","last_fullsized":"2024-03-18T18:09:13.824203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591378+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:09:13.591378+0000","last_peered":"2024-03-18T18:09:13.591378+0000","last_clean":"2024-03-18T18:09:13.591378+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:09:13.591378+0000","last_undegraded":"2024-03-18T18:09:13.591378+0000","last_fullsized":"2024-03-18T18:09:13.591378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591339+0000","last_change":"2024-03-18T18:09:12.828703+0000","last_active":"2024-03-18T18:09:13.591339+0000","last_peered":"2024-03-18T18:09:13.591339+0000","last_clean":"2024-03-18T18:09:13.591339+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:09:13.591339+0000","last_undegraded":"2024-03-18T18:09:13.591339+0000","last_fullsized":"2024-03-18T18:09:13.591339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824553+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:09:13.824553+0000","last_peered":"2024-03-18T18:09:13.824553+0000","last_clean":"2024-03-18T18:09:13.824553+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:09:13.824553+0000","last_undegraded":"2024-03-18T18:09:13.824553+0000","last_fullsized":"2024-03-18T18:09:13.824553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822841+0000","last_change":"2024-03-18T18:09:12.824723+0000","last_active":"2024-03-18T18:09:13.822841+0000","last_peered":"2024-03-18T18:09:13.822841+0000","last_clean":"2024-03-18T18:09:13.822841+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:09:13.822841+0000","last_undegraded":"2024-03-18T18:09:13.822841+0000","last_fullsized":"2024-03-18T18:09:13.822841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824781+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:09:13.824781+0000","last_peered":"2024-03-18T18:09:13.824781+0000","last_clean":"2024-03-18T18:09:13.824781+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:09:13.824781+0000","last_undegraded":"2024-03-18T18:09:13.824781+0000","last_fullsized":"2024-03-18T18:09:13.824781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824739+0000","last_change":"2024-03-18T18:09:12.843128+0000","last_active":"2024-03-18T18:09:13.824739+0000","last_peered":"2024-03-18T18:09:13.824739+0000","last_clean":"2024-03-18T18:09:13.824739+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:09:13.824739+0000","last_undegraded":"2024-03-18T18:09:13.824739+0000","last_fullsized":"2024-03-18T18:09:13.824739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824800+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:09:13.824800+0000","last_peered":"2024-03-18T18:09:13.824800+0000","last_clean":"2024-03-18T18:09:13.824800+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:09:13.824800+0000","last_undegraded":"2024-03-18T18:09:13.824800+0000","last_fullsized":"2024-03-18T18:09:13.824800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594244+0000","last_change":"2024-03-18T18:09:12.850559+0000","last_active":"2024-03-18T18:09:13.594244+0000","last_peered":"2024-03-18T18:09:13.594244+0000","last_clean":"2024-03-18T18:09:13.594244+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:09:13.594244+0000","last_undegraded":"2024-03-18T18:09:13.594244+0000","last_fullsized":"2024-03-18T18:09:13.594244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823072+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:09:13.823072+0000","last_peered":"2024-03-18T18:09:13.823072+0000","last_clean":"2024-03-18T18:09:13.823072+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:09:13.823072+0000","last_undegraded":"2024-03-18T18:09:13.823072+0000","last_fullsized":"2024-03-18T18:09:13.823072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593069+0000","last_change":"2024-03-18T18:09:12.837565+0000","last_active":"2024-03-18T18:09:15.593069+0000","last_peered":"2024-03-18T18:09:15.593069+0000","last_clean":"2024-03-18T18:09:15.593069+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:09:15.593069+0000","last_undegraded":"2024-03-18T18:09:15.593069+0000","last_fullsized":"2024-03-18T18:09:15.593069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824406+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:09:13.824406+0000","last_peered":"2024-03-18T18:09:13.824406+0000","last_clean":"2024-03-18T18:09:13.824406+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:09:13.824406+0000","last_undegraded":"2024-03-18T18:09:13.824406+0000","last_fullsized":"2024-03-18T18:09:13.824406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224581+0000","last_change":"2024-03-18T18:09:12.830990+0000","last_active":"2024-03-18T18:09:15.224581+0000","last_peered":"2024-03-18T18:09:15.224581+0000","last_clean":"2024-03-18T18:09:15.224581+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:09:15.224581+0000","last_undegraded":"2024-03-18T18:09:15.224581+0000","last_fullsized":"2024-03-18T18:09:15.224581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594189+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:09:13.594189+0000","last_peered":"2024-03-18T18:09:13.594189+0000","last_clean":"2024-03-18T18:09:13.594189+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:09:13.594189+0000","last_undegraded":"2024-03-18T18:09:13.594189+0000","last_fullsized":"2024-03-18T18:09:13.594189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594140+0000","last_change":"2024-03-18T18:09:12.831593+0000","last_active":"2024-03-18T18:09:13.594140+0000","last_peered":"2024-03-18T18:09:13.594140+0000","last_clean":"2024-03-18T18:09:13.594140+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:09:13.594140+0000","last_undegraded":"2024-03-18T18:09:13.594140+0000","last_fullsized":"2024-03-18T18:09:13.594140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825559+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:09:13.825559+0000","last_peered":"2024-03-18T18:09:13.825559+0000","last_clean":"2024-03-18T18:09:13.825559+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:09:13.825559+0000","last_undegraded":"2024-03-18T18:09:13.825559+0000","last_fullsized":"2024-03-18T18:09:13.825559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224731+0000","last_change":"2024-03-18T18:09:12.839323+0000","last_active":"2024-03-18T18:09:15.224731+0000","last_peered":"2024-03-18T18:09:15.224731+0000","last_clean":"2024-03-18T18:09:15.224731+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:09:15.224731+0000","last_undegraded":"2024-03-18T18:09:15.224731+0000","last_fullsized":"2024-03-18T18:09:15.224731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824196+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:09:13.824196+0000","last_peered":"2024-03-18T18:09:13.824196+0000","last_clean":"2024-03-18T18:09:13.824196+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:09:13.824196+0000","last_undegraded":"2024-03-18T18:09:13.824196+0000","last_fullsized":"2024-03-18T18:09:13.824196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825747+0000","last_change":"2024-03-18T18:09:12.847297+0000","last_active":"2024-03-18T18:09:13.825747+0000","last_peered":"2024-03-18T18:09:13.825747+0000","last_clean":"2024-03-18T18:09:13.825747+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:09:13.825747+0000","last_undegraded":"2024-03-18T18:09:13.825747+0000","last_fullsized":"2024-03-18T18:09:13.825747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592391+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:09:14.592391+0000","last_peered":"2024-03-18T18:09:14.592391+0000","last_clean":"2024-03-18T18:09:14.592391+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:09:14.592391+0000","last_undegraded":"2024-03-18T18:09:14.592391+0000","last_fullsized":"2024-03-18T18:09:14.592391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224387+0000","last_change":"2024-03-18T18:09:12.838637+0000","last_active":"2024-03-18T18:09:15.224387+0000","last_peered":"2024-03-18T18:09:15.224387+0000","last_clean":"2024-03-18T18:09:15.224387+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:09:15.224387+0000","last_undegraded":"2024-03-18T18:09:15.224387+0000","last_fullsized":"2024-03-18T18:09:15.224387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593097+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:09:15.593097+0000","last_peered":"2024-03-18T18:09:15.593097+0000","last_clean":"2024-03-18T18:09:15.593097+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:09:15.593097+0000","last_undegraded":"2024-03-18T18:09:15.593097+0000","last_fullsized":"2024-03-18T18:09:15.593097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225074+0000","last_change":"2024-03-18T18:09:12.838775+0000","last_active":"2024-03-18T18:09:15.225074+0000","last_peered":"2024-03-18T18:09:15.225074+0000","last_clean":"2024-03-18T18:09:15.225074+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:09:15.225074+0000","last_undegraded":"2024-03-18T18:09:15.225074+0000","last_fullsized":"2024-03-18T18:09:15.225074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592654+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:09:14.592654+0000","last_peered":"2024-03-18T18:09:14.592654+0000","last_clean":"2024-03-18T18:09:14.592654+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:09:14.592654+0000","last_undegraded":"2024-03-18T18:09:14.592654+0000","last_fullsized":"2024-03-18T18:09:14.592654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225593+0000","last_change":"2024-03-18T18:09:12.841196+0000","last_active":"2024-03-18T18:09:15.225593+0000","last_peered":"2024-03-18T18:09:15.225593+0000","last_clean":"2024-03-18T18:09:15.225593+0000","last_became_active":"2024-03-18T18:09:12.840659+0000","last_became_peered":"2024-03-18T18:09:12.840659+0000","last_unstale":"2024-03-18T18:09:15.225593+0000","last_undegraded":"2024-03-18T18:09:15.225593+0000","last_fullsized":"2024-03-18T18:09:15.225593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823141+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:09:13.823141+0000","last_peered":"2024-03-18T18:09:13.823141+0000","last_clean":"2024-03-18T18:09:13.823141+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:09:13.823141+0000","last_undegraded":"2024-03-18T18:09:13.823141+0000","last_fullsized":"2024-03-18T18:09:13.823141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825348+0000","last_change":"2024-03-18T18:09:12.834479+0000","last_active":"2024-03-18T18:09:13.825348+0000","last_peered":"2024-03-18T18:09:13.825348+0000","last_clean":"2024-03-18T18:09:13.825348+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:09:13.825348+0000","last_undegraded":"2024-03-18T18:09:13.825348+0000","last_fullsized":"2024-03-18T18:09:13.825348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592567+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:09:14.592567+0000","last_peered":"2024-03-18T18:09:14.592567+0000","last_clean":"2024-03-18T18:09:14.592567+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:09:14.592567+0000","last_undegraded":"2024-03-18T18:09:14.592567+0000","last_fullsized":"2024-03-18T18:09:14.592567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224685+0000","last_change":"2024-03-18T18:09:12.845096+0000","last_active":"2024-03-18T18:09:15.224685+0000","last_peered":"2024-03-18T18:09:15.224685+0000","last_clean":"2024-03-18T18:09:15.224685+0000","last_became_active":"2024-03-18T18:09:12.844794+0000","last_became_peered":"2024-03-18T18:09:12.844794+0000","last_unstale":"2024-03-18T18:09:15.224685+0000","last_undegraded":"2024-03-18T18:09:15.224685+0000","last_fullsized":"2024-03-18T18:09:15.224685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:47.908637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:12.822307+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:09:12.822307+0000","last_peered":"2024-03-18T18:09:12.822307+0000","last_clean":"2024-03-18T18:09:12.822307+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:09:12.822307+0000","last_undegraded":"2024-03-18T18:09:12.822307+0000","last_fullsized":"2024-03-18T18:09:12.822307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824253+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:09:13.824253+0000","last_peered":"2024-03-18T18:09:13.824253+0000","last_clean":"2024-03-18T18:09:13.824253+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:09:13.824253+0000","last_undegraded":"2024-03-18T18:09:13.824253+0000","last_fullsized":"2024-03-18T18:09:13.824253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591391+0000","last_change":"2024-03-18T18:09:12.850021+0000","last_active":"2024-03-18T18:09:13.591391+0000","last_peered":"2024-03-18T18:09:13.591391+0000","last_clean":"2024-03-18T18:09:13.591391+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:09:13.591391+0000","last_undegraded":"2024-03-18T18:09:13.591391+0000","last_fullsized":"2024-03-18T18:09:13.591391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224061+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:09:15.224061+0000","last_peered":"2024-03-18T18:09:15.224061+0000","last_clean":"2024-03-18T18:09:15.224061+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:09:15.224061+0000","last_undegraded":"2024-03-18T18:09:15.224061+0000","last_fullsized":"2024-03-18T18:09:15.224061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594096+0000","last_change":"2024-03-18T18:09:12.838921+0000","last_active":"2024-03-18T18:09:13.594096+0000","last_peered":"2024-03-18T18:09:13.594096+0000","last_clean":"2024-03-18T18:09:13.594096+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:09:13.594096+0000","last_undegraded":"2024-03-18T18:09:13.594096+0000","last_fullsized":"2024-03-18T18:09:13.594096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592521+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:09:14.592521+0000","last_peered":"2024-03-18T18:09:14.592521+0000","last_clean":"2024-03-18T18:09:14.592521+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:09:14.592521+0000","last_undegraded":"2024-03-18T18:09:14.592521+0000","last_fullsized":"2024-03-18T18:09:14.592521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822734+0000","last_change":"2024-03-18T18:09:12.822692+0000","last_active":"2024-03-18T18:09:13.822734+0000","last_peered":"2024-03-18T18:09:13.822734+0000","last_clean":"2024-03-18T18:09:13.822734+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:09:13.822734+0000","last_undegraded":"2024-03-18T18:09:13.822734+0000","last_fullsized":"2024-03-18T18:09:13.822734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825607+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:09:13.825607+0000","last_peered":"2024-03-18T18:09:13.825607+0000","last_clean":"2024-03-18T18:09:13.825607+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:09:13.825607+0000","last_undegraded":"2024-03-18T18:09:13.825607+0000","last_fullsized":"2024-03-18T18:09:13.825607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.593014+0000","last_change":"2024-03-18T18:09:12.835734+0000","last_active":"2024-03-18T18:09:15.593014+0000","last_peered":"2024-03-18T18:09:15.593014+0000","last_clean":"2024-03-18T18:09:15.593014+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:09:15.593014+0000","last_undegraded":"2024-03-18T18:09:15.593014+0000","last_fullsized":"2024-03-18T18:09:15.593014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822995+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:09:13.822995+0000","last_peered":"2024-03-18T18:09:13.822995+0000","last_clean":"2024-03-18T18:09:13.822995+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:09:13.822995+0000","last_undegraded":"2024-03-18T18:09:13.822995+0000","last_fullsized":"2024-03-18T18:09:13.822995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824964+0000","last_change":"2024-03-18T18:09:12.842890+0000","last_active":"2024-03-18T18:09:13.824964+0000","last_peered":"2024-03-18T18:09:13.824964+0000","last_clean":"2024-03-18T18:09:13.824964+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:09:13.824964+0000","last_undegraded":"2024-03-18T18:09:13.824964+0000","last_fullsized":"2024-03-18T18:09:13.824964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.225099+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:09:15.225099+0000","last_peered":"2024-03-18T18:09:15.225099+0000","last_clean":"2024-03-18T18:09:15.225099+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:09:15.225099+0000","last_undegraded":"2024-03-18T18:09:15.225099+0000","last_fullsized":"2024-03-18T18:09:15.225099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.822874+0000","last_change":"2024-03-18T18:09:12.821957+0000","last_active":"2024-03-18T18:09:13.822874+0000","last_peered":"2024-03-18T18:09:13.822874+0000","last_clean":"2024-03-18T18:09:13.822874+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:09:13.822874+0000","last_undegraded":"2024-03-18T18:09:13.822874+0000","last_fullsized":"2024-03-18T18:09:13.822874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:14.592881+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:09:14.592881+0000","last_peered":"2024-03-18T18:09:14.592881+0000","last_clean":"2024-03-18T18:09:14.592881+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:09:14.592881+0000","last_undegraded":"2024-03-18T18:09:14.592881+0000","last_fullsized":"2024-03-18T18:09:14.592881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591506+0000","last_change":"2024-03-18T18:09:12.832793+0000","last_active":"2024-03-18T18:09:13.591506+0000","last_peered":"2024-03-18T18:09:13.591506+0000","last_clean":"2024-03-18T18:09:13.591506+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:09:13.591506+0000","last_undegraded":"2024-03-18T18:09:13.591506+0000","last_fullsized":"2024-03-18T18:09:13.591506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824875+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:09:13.824875+0000","last_peered":"2024-03-18T18:09:13.824875+0000","last_clean":"2024-03-18T18:09:13.824875+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:09:13.824875+0000","last_undegraded":"2024-03-18T18:09:13.824875+0000","last_fullsized":"2024-03-18T18:09:13.824875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594215+0000","last_change":"2024-03-18T18:09:12.829268+0000","last_active":"2024-03-18T18:09:13.594215+0000","last_peered":"2024-03-18T18:09:13.594215+0000","last_clean":"2024-03-18T18:09:13.594215+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:09:13.594215+0000","last_undegraded":"2024-03-18T18:09:13.594215+0000","last_fullsized":"2024-03-18T18:09:13.594215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224023+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:09:15.224023+0000","last_peered":"2024-03-18T18:09:15.224023+0000","last_clean":"2024-03-18T18:09:15.224023+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:09:15.224023+0000","last_undegraded":"2024-03-18T18:09:15.224023+0000","last_fullsized":"2024-03-18T18:09:15.224023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.592954+0000","last_change":"2024-03-18T18:09:12.824858+0000","last_active":"2024-03-18T18:09:15.592954+0000","last_peered":"2024-03-18T18:09:15.592954+0000","last_clean":"2024-03-18T18:09:15.592954+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:09:15.592954+0000","last_undegraded":"2024-03-18T18:09:15.592954+0000","last_fullsized":"2024-03-18T18:09:15.592954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823079+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:09:13.823079+0000","last_peered":"2024-03-18T18:09:13.823079+0000","last_clean":"2024-03-18T18:09:13.823079+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:09:13.823079+0000","last_undegraded":"2024-03-18T18:09:13.823079+0000","last_fullsized":"2024-03-18T18:09:13.823079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591353+0000","last_change":"2024-03-18T18:09:12.828396+0000","last_active":"2024-03-18T18:09:13.591353+0000","last_peered":"2024-03-18T18:09:13.591353+0000","last_clean":"2024-03-18T18:09:13.591353+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:09:13.591353+0000","last_undegraded":"2024-03-18T18:09:13.591353+0000","last_fullsized":"2024-03-18T18:09:13.591353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.823186+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:09:13.823186+0000","last_peered":"2024-03-18T18:09:13.823186+0000","last_clean":"2024-03-18T18:09:13.823186+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:09:13.823186+0000","last_undegraded":"2024-03-18T18:09:13.823186+0000","last_fullsized":"2024-03-18T18:09:13.823186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591425+0000","last_change":"2024-03-18T18:09:12.832230+0000","last_active":"2024-03-18T18:09:13.591425+0000","last_peered":"2024-03-18T18:09:13.591425+0000","last_clean":"2024-03-18T18:09:13.591425+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:09:13.591425+0000","last_undegraded":"2024-03-18T18:09:13.591425+0000","last_fullsized":"2024-03-18T18:09:13.591425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224945+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:09:15.224945+0000","last_peered":"2024-03-18T18:09:15.224945+0000","last_clean":"2024-03-18T18:09:15.224945+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:09:15.224945+0000","last_undegraded":"2024-03-18T18:09:15.224945+0000","last_fullsized":"2024-03-18T18:09:15.224945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824060+0000","last_change":"2024-03-18T18:09:12.842987+0000","last_active":"2024-03-18T18:09:13.824060+0000","last_peered":"2024-03-18T18:09:13.824060+0000","last_clean":"2024-03-18T18:09:13.824060+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:09:13.824060+0000","last_undegraded":"2024-03-18T18:09:13.824060+0000","last_fullsized":"2024-03-18T18:09:13.824060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.824811+0000","last_change":"2024-03-18T18:09:12.843474+0000","last_active":"2024-03-18T18:09:13.824811+0000","last_peered":"2024-03-18T18:09:13.824811+0000","last_clean":"2024-03-18T18:09:13.824811+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:09:13.824811+0000","last_undegraded":"2024-03-18T18:09:13.824811+0000","last_fullsized":"2024-03-18T18:09:13.824811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224645+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:09:15.224645+0000","last_peered":"2024-03-18T18:09:15.224645+0000","last_clean":"2024-03-18T18:09:15.224645+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:09:15.224645+0000","last_undegraded":"2024-03-18T18:09:15.224645+0000","last_fullsized":"2024-03-18T18:09:15.224645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.825111+0000","last_change":"2024-03-18T18:09:12.849269+0000","last_active":"2024-03-18T18:09:13.825111+0000","last_peered":"2024-03-18T18:09:13.825111+0000","last_clean":"2024-03-18T18:09:13.825111+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:09:13.825111+0000","last_undegraded":"2024-03-18T18:09:13.825111+0000","last_fullsized":"2024-03-18T18:09:13.825111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T18:09:15.224838+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:09:15.224838+0000","last_peered":"2024-03-18T18:09:15.224838+0000","last_clean":"2024-03-18T18:09:15.224838+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:09:15.224838+0000","last_undegraded":"2024-03-18T18:09:15.224838+0000","last_fullsized":"2024-03-18T18:09:15.224838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594228+0000","last_change":"2024-03-18T18:09:12.850557+0000","last_active":"2024-03-18T18:09:13.594228+0000","last_peered":"2024-03-18T18:09:13.594228+0000","last_clean":"2024-03-18T18:09:13.594228+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:09:13.594228+0000","last_undegraded":"2024-03-18T18:09:13.594228+0000","last_fullsized":"2024-03-18T18:09:13.594228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591482+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:09:13.591482+0000","last_peered":"2024-03-18T18:09:13.591482+0000","last_clean":"2024-03-18T18:09:13.591482+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:09:13.591482+0000","last_undegraded":"2024-03-18T18:09:13.591482+0000","last_fullsized":"2024-03-18T18:09:13.591482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.591469+0000","last_change":"2024-03-18T18:09:12.849237+0000","last_active":"2024-03-18T18:09:13.591469+0000","last_peered":"2024-03-18T18:09:13.591469+0000","last_clean":"2024-03-18T18:09:13.591469+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:09:13.591469+0000","last_undegraded":"2024-03-18T18:09:13.591469+0000","last_fullsized":"2024-03-18T18:09:13.591469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T18:09:13.594270+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:09:13.594270+0000","last_peered":"2024-03-18T18:09:13.594270+0000","last_clean":"2024-03-18T18:09:13.594270+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:09:13.594270+0000","last_undegraded":"2024-03-18T18:09:13.594270+0000","last_fullsized":"2024-03-18T18:09:13.594270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.736}]}]},{"osd":4,"up_from":16,"seq":68719476742,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":75868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":225280,"data_stored":76028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":229376,"data_stored":77432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":823296,"data_stored":666874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:09:24.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T18:09:24.608 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-18T18:09:24.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-18T18:09:24.608 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-18T18:09:24.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4ffff700 1 Processor -- start 2024-03-18T18:09:24.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4ffff700 1 -- start start 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c500af540 0x7f8c5013d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4ffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c500701c0 con 0x7f8c5006be70 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4ffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5013d9d0 con 0x7f8c5013d570 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006c250 con 0x7f8c500af540 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4effd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8c5006be70 0x7f8c500706d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39738/0 (socket says 172.21.15.94:39738) 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4effd700 1 -- 172.21.15.94:0/4278136031 learned_addr learned my addr 172.21.15.94:0/4278136031 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.708+0000 7f8c4e7fc700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c500af540 0x7f8c5013d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578416014 0 0) 0x7f8c500701c0 con 0x7f8c5006be70 2024-03-18T18:09:24.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c3c0035d0 con 0x7f8c5006be70 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879491164 0 0) 0x7f8c5013d9d0 con 0x7f8c5013d570 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c500701c0 con 0x7f8c5013d570 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209078783 0 0) 0x7f8c3c0035d0 con 0x7f8c5006be70 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c500af540 msgr2=0x7f8c5013d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c500af540 0x7f8c5013d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 >> v1:172.21.15.151:6789/0 conn(0x7f8c5013d570 legacy=0x7f8c5014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500b5120 con 0x7f8c5006be70 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f8c38001670 con 0x7f8c5006be70 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 >> v1:172.21.15.94:6789/0 conn(0x7f8c5006be70 legacy=0x7f8c500706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c3c003be0 0x7f8c3c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c004870 0x7f8c3c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c3c005230 0x7f8c3c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006c250 con 0x7f8c3c003be0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c00e230 con 0x7f8c3c005230 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c00e3f0 con 0x7f8c3c004870 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4e7fc700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c500af540 0x7f8c5013d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c3c003be0 0x7f8c3c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4f7fe700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c3c005230 0x7f8c3c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4e7fc700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c004870 0x7f8c3c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 -- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c004870 msgr2=0x7f8c3c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c004870 0x7f8c3c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 -- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c3c005230 msgr2=0x7f8c3c00dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c3c005230 0x7f8c3c00dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 -- 172.21.15.94:0/4278136031 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0035d0 con 0x7f8c3c003be0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4effd700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c3c003be0 0x7f8c3c003fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c240 tx=0x7f8c3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881a9431718681f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800cde0 con 0x7f8c3c003be0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38005980 con 0x7f8c3c003be0 2024-03-18T18:09:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4dffb700 1 -- 172.21.15.94:0/4278136031 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38005d30 con 0x7f8c3c003be0 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4ffff700 1 -- 172.21.15.94:0/4278136031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c3c003be0 msgr2=0x7f8c3c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/4278136031 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c3c003be0 0x7f8c3c003fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800c240 tx=0x7f8c3c0058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4f7fe700 1 -- 172.21.15.94:0/4278136031 reap_dead start 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4ffff700 1 -- 172.21.15.94:0/4278136031 shutdown_connections 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4ffff700 1 -- 172.21.15.94:0/4278136031 >> 172.21.15.94:0/4278136031 conn(0x7f8c500b8d80 msgr2=0x7f8c500b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4ffff700 1 -- 172.21.15.94:0/4278136031 shutdown_connections 2024-03-18T18:09:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.712+0000 7f8c4ffff700 1 -- 172.21.15.94:0/4278136031 wait complete. 2024-03-18T18:09:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 Processor -- start 2024-03-18T18:09:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 -- start start 2024-03-18T18:09:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c003be0 0x7f8c50144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c50145850 0x7f8c50145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 0x7f8c501df650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5013db20 con 0x7f8c501df1d0 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5013ddc0 con 0x7f8c50145850 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5013f080 con 0x7f8c3c003be0 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 0x7f8c501df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 0x7f8c501df650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60894/0 (socket says 172.21.15.94:60894) 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 -- 172.21.15.94:0/1688517248 learned_addr learned my addr 172.21.15.94:0/1688517248 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4e7fc700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c50145850 0x7f8c50145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4effd700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c003be0 0x7f8c50144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 -- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c003be0 msgr2=0x7f8c50144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c003be0 0x7f8c50144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.720 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 -- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c50145850 msgr2=0x7f8c50145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c50145850 0x7f8c50145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 -- 172.21.15.94:0/1688517248 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c501443c0 con 0x7f8c501df1d0 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4e7fc700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c50145850 0x7f8c50145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4f7fe700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 0x7f8c501df650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c500b4a70 tx=0x7f8c4800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48003c30 con 0x7f8c501df1d0 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48003d90 con 0x7f8c501df1d0 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c501454a0 con 0x7f8c501df1d0 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800dbd0 con 0x7f8c501df1d0 2024-03-18T18:09:24.721 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.716+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c50146430 con 0x7f8c501df1d0 2024-03-18T18:09:24.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.720+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c500b3290 con 0x7f8c501df1d0 2024-03-18T18:09:24.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.720+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8c4800dd30 con 0x7f8c501df1d0 2024-03-18T18:09:24.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.720+0000 7f8c477fe700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8c30066760 0x7f8c30068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:24.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.720+0000 7f8c4effd700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8c30066760 0x7f8c30068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.720+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c48084430 con 0x7f8c501df1d0 2024-03-18T18:09:24.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.724+0000 7f8c4effd700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8c30066760 0x7f8c30068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c380018b0 tx=0x7f8c3800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.728+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8c48051830 con 0x7f8c501df1d0 2024-03-18T18:09:24.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.920+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8c50074440 con 0x7f8c501df1d0 2024-03-18T18:09:24.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.920+0000 7f8c477fe700 1 -- 172.21.15.94:0/1688517248 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8c48054e50 con 0x7f8c501df1d0 2024-03-18T18:09:24.922 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:24.922 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8c30066760 msgr2=0x7f8c30068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8c30066760 0x7f8c30068c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c380018b0 tx=0x7f8c3800a000 comp rx=0 tx=0).stop 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 msgr2=0x7f8c501df650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 0x7f8c501df650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c500b4a70 tx=0x7f8c4800d430 comp rx=0 tx=0).stop 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 shutdown_connections 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8c30066760 0x7f8c30068c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c501df1d0 0x7f8c501df650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c50145850 0x7f8c50145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 --2- 172.21.15.94:0/1688517248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c3c003be0 0x7f8c50144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 >> 172.21.15.94:0/1688517248 conn(0x7f8c500b8d80 msgr2=0x7f8c500706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 shutdown_connections 2024-03-18T18:09:24.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:24.924+0000 7f8c4ffff700 1 -- 172.21.15.94:0/1688517248 wait complete. 2024-03-18T18:09:24.935 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-18T18:09:24.935 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 Processor -- start 2024-03-18T18:09:25.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 -- start start 2024-03-18T18:09:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14c40b1000 0x7f14c414e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c414e9c0 0x7f14c4144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c40af790 con 0x7f14c414e0a0 2024-03-18T18:09:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c40af210 con 0x7f14c40b1000 2024-03-18T18:09:25.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c889a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c406e700 con 0x7f14c414e9c0 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c2ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14c40b1000 0x7f14c414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c414e9c0 0x7f14c4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c2ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14c40b1000 0x7f14c414e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:38550/0 (socket says 172.21.15.94:38550) 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.040+0000 7f14c2ffd700 1 -- 172.21.15.94:0/2234824343 learned_addr learned my addr 172.21.15.94:0/2234824343 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c2ffd700 1 -- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c414e9c0 msgr2=0x7f14c4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c2ffd700 1 --2- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c414e9c0 0x7f14c4144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c2ffd700 1 -- 172.21.15.94:0/2234824343 >> v1:172.21.15.151:6789/0 conn(0x7f14c414e0a0 legacy=0x7f14c40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c2ffd700 1 -- 172.21.15.94:0/2234824343 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40af420 con 0x7f14c40b1000 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c27fc700 1 -- 172.21.15.94:0/2234824343 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187463805 0 0) 0x7f14c40af790 con 0x7f14c414e0a0 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c3fff700 1 --2- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c414e9c0 0x7f14c4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c2ffd700 1 --2- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c40b1000 0x7f14c414e480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c40af350 tx=0x7f14ac009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ff80f0b8d7566e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c27fc700 1 -- 172.21.15.94:0/2234824343 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac004230 con 0x7f14c40b1000 2024-03-18T18:09:25.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c27fc700 1 -- 172.21.15.94:0/2234824343 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac004390 con 0x7f14c40b1000 2024-03-18T18:09:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c27fc700 1 -- 172.21.15.94:0/2234824343 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0036c0 con 0x7f14c40b1000 2024-03-18T18:09:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 -- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c40b1000 msgr2=0x7f14c414e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 --2- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c40b1000 0x7f14c414e480 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c40af350 tx=0x7f14ac009bf0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 -- 172.21.15.94:0/2234824343 shutdown_connections 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 --2- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c414e9c0 0x7f14c4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 --2- 172.21.15.94:0/2234824343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c40b1000 0x7f14c414e480 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 -- 172.21.15.94:0/2234824343 >> 172.21.15.94:0/2234824343 conn(0x7f14c40b7a20 msgr2=0x7f14c40b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 -- 172.21.15.94:0/2234824343 shutdown_connections 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 -- 172.21.15.94:0/2234824343 wait complete. 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 Processor -- start 2024-03-18T18:09:25.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.044+0000 7f14c889a700 1 -- start start 2024-03-18T18:09:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 0x7f14c414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c414e9c0 0x7f14c41450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c4146e90 0x7f14c4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c414ab20 con 0x7f14c414e0a0 2024-03-18T18:09:25.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4147cd0 con 0x7f14c414e9c0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c41481c0 con 0x7f14c4146e90 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 0x7f14c414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 0x7f14c414af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60898/0 (socket says 172.21.15.94:60898) 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 -- 172.21.15.94:0/350778447 learned_addr learned my addr 172.21.15.94:0/350778447 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c2ffd700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c414e9c0 0x7f14c41450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c3fff700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c4146e90 0x7f14c4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 -- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c4146e90 msgr2=0x7f14c4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c4146e90 0x7f14c4071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 -- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c414e9c0 msgr2=0x7f14c41450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c414e9c0 0x7f14c41450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 -- 172.21.15.94:0/350778447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0094b0 con 0x7f14c414e0a0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c3fff700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c4146e90 0x7f14c4071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c37fe700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 0x7f14c414af40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14b400cca0 tx=0x7f14b400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4003e50 con 0x7f14c414e0a0 2024-03-18T18:09:25.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b400a810 con 0x7f14c414e0a0 2024-03-18T18:09:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac009570 con 0x7f14c414e0a0 2024-03-18T18:09:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400abc0 con 0x7f14c414e0a0 2024-03-18T18:09:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.048+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c4147ee0 con 0x7f14c414e0a0 2024-03-18T18:09:25.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.052+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c40b4320 con 0x7f14c414e0a0 2024-03-18T18:09:25.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.052+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f14b400ad20 con 0x7f14c414e0a0 2024-03-18T18:09:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.052+0000 7f14bbfff700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f14a4066730 0x7f14a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.052+0000 7f14c2ffd700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f14a4066730 0x7f14a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.052+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b40841e0 con 0x7f14c414e0a0 2024-03-18T18:09:25.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.052+0000 7f14c2ffd700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f14a4066730 0x7f14a4068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c40af350 tx=0x7f14ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.056+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f14b40515e0 con 0x7f14c414e0a0 2024-03-18T18:09:25.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.216+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14c40b1780 con 0x7f14c414e0a0 2024-03-18T18:09:25.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.216+0000 7f14bbfff700 1 -- 172.21.15.94:0/350778447 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f14b4054c00 con 0x7f14c414e0a0 2024-03-18T18:09:25.217 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:25.217 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":22,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:13.808682+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:25.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f14a4066730 msgr2=0x7f14a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f14a4066730 0x7f14a4068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c40af350 tx=0x7f14ac008030 comp rx=0 tx=0).stop 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 msgr2=0x7f14c414af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 0x7f14c414af40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14b400cca0 tx=0x7f14b400a060 comp rx=0 tx=0).stop 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 shutdown_connections 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f14a4066730 0x7f14a4068bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c4146e90 0x7f14c4071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c414e9c0 0x7f14c41450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 --2- 172.21.15.94:0/350778447 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14c414e0a0 0x7f14c414af40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 >> 172.21.15.94:0/350778447 conn(0x7f14c40b7a20 msgr2=0x7f14c40665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 shutdown_connections 2024-03-18T18:09:25.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.220+0000 7f14c889a700 1 -- 172.21.15.94:0/350778447 wait complete. 2024-03-18T18:09:25.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T18:08:58.619045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T18:09:10.506373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T18:09:11.785352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T18:09:25.231 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T18:09:25.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f0470b71700 1 Processor -- start 2024-03-18T18:09:25.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f0470b71700 1 -- start start 2024-03-18T18:09:25.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f0470b71700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f046c09dd40 0x7f046c146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f0470b71700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c0b8590 con 0x7f046c06a3c0 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f0470b71700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c1472c0 con 0x7f046c0b7390 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f0470b71700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c09bb60 con 0x7f046c09dd40 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f046b7fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f046c06a3c0 0x7f046c0b6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39752/0 (socket says 172.21.15.94:39752) 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f046b7fe700 1 -- 172.21.15.94:0/42602888 learned_addr learned my addr 172.21.15.94:0/42602888 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f046bfff700 1 --2- 172.21.15.94:0/42602888 >> v2:172.21.15.151:3300/0 conn(0x7f046c09dd40 0x7f046c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.340+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506127455 0 0) 0x7f046c0b8590 con 0x7f046c06a3c0 2024-03-18T18:09:25.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04540035d0 con 0x7f046c06a3c0 2024-03-18T18:09:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 858697385 0 0) 0x7f04540035d0 con 0x7f046c06a3c0 2024-03-18T18:09:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 >> v2:172.21.15.151:3300/0 conn(0x7f046c09dd40 msgr2=0x7f046c146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 --2- 172.21.15.94:0/42602888 >> v2:172.21.15.151:3300/0 conn(0x7f046c09dd40 0x7f046c146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 >> v1:172.21.15.151:6789/0 conn(0x7f046c0b7390 legacy=0x7f046c09d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c06a7a0 con 0x7f046c06a3c0 2024-03-18T18:09:25.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f0460001670 con 0x7f046c06a3c0 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 >> v1:172.21.15.94:6789/0 conn(0x7f046c06a3c0 legacy=0x7f046c0b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0454003a20 0x7f0454003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0454004870 0x7f0454004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f045400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c09bb60 con 0x7f0454005230 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045400c0d0 con 0x7f0454004870 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045400c290 con 0x7f0454003a20 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f045400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046affd700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0454004870 0x7f0454004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046b7fe700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0454003a20 0x7f0454003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 -- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0454003a20 msgr2=0x7f0454003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0454003a20 0x7f0454003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 -- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0454004870 msgr2=0x7f0454004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0454004870 0x7f0454004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 -- 172.21.15.94:0/42602888 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540035d0 con 0x7f0454005230 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046affd700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0454004870 0x7f0454004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 -- 172.21.15.94:0/42602888 reap_dead start 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046bfff700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f045400ba30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0464009fc0 tx=0x7f04540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3c11f3848fdde2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464003a40 con 0x7f0454005230 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046400f040 con 0x7f0454005230 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f046a7fc700 1 -- 172.21.15.94:0/42602888 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464003e00 con 0x7f0454005230 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 -- 172.21.15.94:0/42602888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 msgr2=0x7f045400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f045400ba30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0464009fc0 tx=0x7f04540058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 -- 172.21.15.94:0/42602888 shutdown_connections 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 --2- 172.21.15.94:0/42602888 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f045400ba30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 -- 172.21.15.94:0/42602888 >> 172.21.15.94:0/42602888 conn(0x7f046c0bbda0 msgr2=0x7f046c0bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 -- 172.21.15.94:0/42602888 shutdown_connections 2024-03-18T18:09:25.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.344+0000 7f0470b71700 1 -- 172.21.15.94:0/42602888 wait complete. 2024-03-18T18:09:25.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 Processor -- start 2024-03-18T18:09:25.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 -- start start 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f046c0baf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f046c09e7b0 0x7f046c0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f046c0b58c0 0x7f046c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0bb780 con 0x7f0454005230 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0b78f0 con 0x7f046c09e7b0 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0b4ef0 con 0x7f046c0b58c0 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f046c0baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f046c0baf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60918/0 (socket says 172.21.15.94:60918) 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 -- 172.21.15.94:0/3392163208 learned_addr learned my addr 172.21.15.94:0/3392163208 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046affd700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f046c09e7b0 0x7f046c0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046bfff700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f046c0b58c0 0x7f046c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 -- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f046c0b58c0 msgr2=0x7f046c0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f046c0b58c0 0x7f046c0b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 -- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f046c09e7b0 msgr2=0x7f046c0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f046c09e7b0 0x7f046c0b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 -- 172.21.15.94:0/3392163208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c09ef50 con 0x7f0454005230 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046affd700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f046c09e7b0 0x7f046c0b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f046b7fe700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f046c0baf40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0460007340 tx=0x7f0460007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460007820 con 0x7f0454005230 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000f8d0 con 0x7f0454005230 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c09ec70 con 0x7f0454005230 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000fc60 con 0x7f0454005230 2024-03-18T18:09:25.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.348+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c0b29d0 con 0x7f0454005230 2024-03-18T18:09:25.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.352+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f046001d460 con 0x7f0454005230 2024-03-18T18:09:25.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.352+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c074440 con 0x7f0454005230 2024-03-18T18:09:25.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.352+0000 7f0453fff700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0458066760 0x7f0458068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.352+0000 7f046affd700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0458066760 0x7f0458068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.352+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04600840f0 con 0x7f0454005230 2024-03-18T18:09:25.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.352+0000 7f046affd700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0458066760 0x7f0458068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f045c000c00 tx=0x7f045c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.360+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0460051530 con 0x7f0454005230 2024-03-18T18:09:25.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.519+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f046c0b4cc0 con 0x7f0454005230 2024-03-18T18:09:25.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.519+0000 7f0453fff700 1 -- 172.21.15.94:0/3392163208 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0460054b50 con 0x7f0454005230 2024-03-18T18:09:25.523 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0458066760 msgr2=0x7f0458068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0458066760 0x7f0458068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f045c000c00 tx=0x7f045c009040 comp rx=0 tx=0).stop 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 msgr2=0x7f046c0baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f046c0baf40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0460007340 tx=0x7f0460007700 comp rx=0 tx=0).stop 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 shutdown_connections 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0458066760 0x7f0458068c20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f046c0b58c0 0x7f046c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f046c09e7b0 0x7f046c0b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 --2- 172.21.15.94:0/3392163208 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0454005230 0x7f046c0baf40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 >> 172.21.15.94:0/3392163208 conn(0x7f046c0bbda0 msgr2=0x7f046c0665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 shutdown_connections 2024-03-18T18:09:25.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.523+0000 7f0470b71700 1 -- 172.21.15.94:0/3392163208 wait complete. 2024-03-18T18:09:25.540 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T18:09:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.647+0000 7ff8accdb700 1 Processor -- start 2024-03-18T18:09:25.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.647+0000 7ff8accdb700 1 -- start start 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8accdb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a80b2d40 0x7ff8a81431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8accdb700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a806fff0 con 0x7ff8a80b93b0 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8accdb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a80b9790 con 0x7ff8a80b2180 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8accdb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a813d9f0 con 0x7ff8a80b2d40 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff8a80b93b0 0x7ff8a80b4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39768/0 (socket says 172.21.15.94:39768) 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 -- 172.21.15.94:0/588617589 learned_addr learned my addr 172.21.15.94:0/588617589 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff89effd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a80b2d40 0x7ff8a81431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872660167 0 0) 0x7ff8a806fff0 con 0x7ff8a80b93b0 2024-03-18T18:09:25.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8940035d0 con 0x7ff8a80b93b0 2024-03-18T18:09:25.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458512873 0 0) 0x7ff8940035d0 con 0x7ff8a80b93b0 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a80b2d40 msgr2=0x7ff8a81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a80b2d40 0x7ff8a81431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 >> v1:172.21.15.151:6789/0 conn(0x7ff8a80b2180 legacy=0x7ff8a814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8070240 con 0x7ff8a80b93b0 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7ff898001670 con 0x7ff8a80b93b0 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 >> v1:172.21.15.94:6789/0 conn(0x7ff8a80b93b0 legacy=0x7ff8a80b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff894003a50 0x7ff894003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff894004870 0x7ff894004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff894005230 0x7ff89400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a813d9f0 con 0x7ff894003a50 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89400c100 con 0x7ff894005230 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89400c2c0 con 0x7ff894004870 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff89effd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a80b2d40 0x7ff8a81431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff894003a50 0x7ff894003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a7fff700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff894005230 0x7ff89400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff89effd700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff894004870 0x7ff894004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 -- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff894004870 msgr2=0x7ff894004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff894004870 0x7ff894004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 -- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff894005230 msgr2=0x7ff89400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff894005230 0x7ff89400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 -- 172.21.15.94:0/588617589 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940035d0 con 0x7ff894003a50 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a7fff700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff894005230 0x7ff89400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff894003a50 0x7ff894003e30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c240 tx=0x7ff8940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dea3940e11c0cd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800cde0 con 0x7ff894003a50 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898005980 con 0x7ff894003a50 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.651+0000 7ff8a6ffd700 1 -- 172.21.15.94:0/588617589 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898005d30 con 0x7ff894003a50 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 -- 172.21.15.94:0/588617589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff894003a50 msgr2=0x7ff894003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 --2- 172.21.15.94:0/588617589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff894003a50 0x7ff894003e30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c240 tx=0x7ff8940058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8a7fff700 1 -- 172.21.15.94:0/588617589 reap_dead start 2024-03-18T18:09:25.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 -- 172.21.15.94:0/588617589 shutdown_connections 2024-03-18T18:09:25.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 -- 172.21.15.94:0/588617589 >> 172.21.15.94:0/588617589 conn(0x7ff8a80b5b60 msgr2=0x7ff8a80b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 -- 172.21.15.94:0/588617589 shutdown_connections 2024-03-18T18:09:25.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 -- 172.21.15.94:0/588617589 wait complete. 2024-03-18T18:09:25.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 Processor -- start 2024-03-18T18:09:25.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.655+0000 7ff8accdb700 1 -- start start 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a813b8a0 0x7ff8a81c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 0x7ff8a81d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a81387f0 0x7ff8a8138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80b5270 con 0x7ff8a81db890 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81c9d90 con 0x7ff8a813b8a0 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a81ca010 con 0x7ff8a81387f0 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 0x7ff8a81d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 0x7ff8a81d76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60940/0 (socket says 172.21.15.94:60940) 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 -- 172.21.15.94:0/2845416535 learned_addr learned my addr 172.21.15.94:0/2845416535 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a813b8a0 0x7ff8a81c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8a7fff700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a81387f0 0x7ff8a8138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 -- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a81387f0 msgr2=0x7ff8a8138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a81387f0 0x7ff8a8138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 -- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a813b8a0 msgr2=0x7ff8a81c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a813b8a0 0x7ff8a81c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 -- 172.21.15.94:0/2845416535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a81dadb0 con 0x7ff8a81db890 2024-03-18T18:09:25.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a813b8a0 0x7ff8a81c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:25.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff89effd700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 0x7ff8a81d76a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff890011800 tx=0x7ff890011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890015870 con 0x7ff8a81db890 2024-03-18T18:09:25.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8900159d0 con 0x7ff8a81db890 2024-03-18T18:09:25.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a81db090 con 0x7ff8a81db890 2024-03-18T18:09:25.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890015d80 con 0x7ff8a81db890 2024-03-18T18:09:25.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.659+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a813bc80 con 0x7ff8a81db890 2024-03-18T18:09:25.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.663+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a81dac10 con 0x7ff8a81db890 2024-03-18T18:09:25.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.663+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff890005a40 con 0x7ff8a81db890 2024-03-18T18:09:25.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.663+0000 7ff8a4ff9700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7ff888066760 0x7ff888068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.663+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff890084690 con 0x7ff8a81db890 2024-03-18T18:09:25.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.663+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7ff888066760 0x7ff888068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.663+0000 7ff8a77fe700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7ff888066760 0x7ff888068c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8a804f760 tx=0x7ff898007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.667+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff8a81dac10 con 0x7ff8a81db890 2024-03-18T18:09:25.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.839+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8a81dac10 con 0x7ff8a81db890 2024-03-18T18:09:25.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.839+0000 7ff8a4ff9700 1 -- 172.21.15.94:0/2845416535 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8a81dac10 con 0x7ff8a81db890 2024-03-18T18:09:25.843 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-03-18T18:09:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7ff888066760 msgr2=0x7ff888068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7ff888066760 0x7ff888068c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8a804f760 tx=0x7ff898007000 comp rx=0 tx=0).stop 2024-03-18T18:09:25.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 msgr2=0x7ff8a81d76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 0x7ff8a81d76a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff890011800 tx=0x7ff890011b10 comp rx=0 tx=0).stop 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 shutdown_connections 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7ff888066760 0x7ff888068c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a81387f0 0x7ff8a8138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8a81db890 0x7ff8a81d76a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 --2- 172.21.15.94:0/2845416535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a813b8a0 0x7ff8a81c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 >> 172.21.15.94:0/2845416535 conn(0x7ff8a80b5b60 msgr2=0x7ff8a80b73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 shutdown_connections 2024-03-18T18:09:25.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.843+0000 7ff8accdb700 1 -- 172.21.15.94:0/2845416535 wait complete. 2024-03-18T18:09:25.857 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T18:09:25.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceffff700 1 Processor -- start 2024-03-18T18:09:25.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceffff700 1 -- start start 2024-03-18T18:09:25.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7facf00b7390 0x7facf0146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf00b8590 con 0x7facf006a3c0 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf01472c0 con 0x7facf009d630 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceffff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf009bb60 con 0x7facf00b7390 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7facee7fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7facf00b7390 0x7facf0146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7facee7fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7facf00b7390 0x7facf0146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60948/0 (socket says 172.21.15.94:60948) 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7faceeffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7facf006a3c0 0x7facf00b6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39774/0 (socket says 172.21.15.94:39774) 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.975+0000 7facee7fc700 1 -- 172.21.15.94:0/1631784164 learned_addr learned my addr 172.21.15.94:0/1631784164 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facee7fc700 1 -- 172.21.15.94:0/1631784164 >> v1:172.21.15.151:6789/0 conn(0x7facf009d630 legacy=0x7facf009da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facee7fc700 1 -- 172.21.15.94:0/1631784164 >> v1:172.21.15.94:6789/0 conn(0x7facf006a3c0 legacy=0x7facf00b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facee7fc700 1 -- 172.21.15.94:0/1631784164 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf006a7a0 con 0x7facf00b7390 2024-03-18T18:09:25.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facee7fc700 1 --2- 172.21.15.94:0/1631784164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf00b7390 0x7facf0146690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7face0009910 tx=0x7face0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9061a8f1b5b0c9f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facedffb700 1 -- 172.21.15.94:0/1631784164 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0004230 con 0x7facf00b7390 2024-03-18T18:09:25.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facedffb700 1 -- 172.21.15.94:0/1631784164 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face0004390 con 0x7facf00b7390 2024-03-18T18:09:25.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facedffb700 1 -- 172.21.15.94:0/1631784164 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face0009e60 con 0x7facf00b7390 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- 172.21.15.94:0/1631784164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf00b7390 msgr2=0x7facf0146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 --2- 172.21.15.94:0/1631784164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf00b7390 0x7facf0146690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7face0009910 tx=0x7face0009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- 172.21.15.94:0/1631784164 shutdown_connections 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 --2- 172.21.15.94:0/1631784164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf00b7390 0x7facf0146690 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- 172.21.15.94:0/1631784164 >> 172.21.15.94:0/1631784164 conn(0x7facf00bbda0 msgr2=0x7facf00bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- 172.21.15.94:0/1631784164 shutdown_connections 2024-03-18T18:09:25.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- 172.21.15.94:0/1631784164 wait complete. 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 Processor -- start 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- start start 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 0x7facf0148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf009d630 0x7facf00b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf01dbb80 0x7facf01dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf00b59d0 con 0x7facf006a3c0 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf00b3330 con 0x7facf01dbb80 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf00b30a0 con 0x7facf009d630 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceeffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 0x7facf0148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceeffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 0x7facf0148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60962/0 (socket says 172.21.15.94:60962) 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7faceeffd700 1 -- 172.21.15.94:0/3608447689 learned_addr learned my addr 172.21.15.94:0/3608447689 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:25.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.979+0000 7facee7fc700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf009d630 0x7facf00b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7facef7fe700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf01dbb80 0x7facf01dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceeffd700 1 -- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf009d630 msgr2=0x7facf00b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceeffd700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf009d630 0x7facf00b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceeffd700 1 -- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf01dbb80 msgr2=0x7facf01dc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceeffd700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf01dbb80 0x7facf01dc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceeffd700 1 -- 172.21.15.94:0/3608447689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009570 con 0x7facf006a3c0 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7facee7fc700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf009d630 0x7facf00b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:25.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceeffd700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 0x7facf0148f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd800c500 tx=0x7facd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8005cd0 con 0x7facf006a3c0 2024-03-18T18:09:25.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8005e30 con 0x7facf006a3c0 2024-03-18T18:09:25.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf00b3580 con 0x7facf006a3c0 2024-03-18T18:09:25.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80072f0 con 0x7facf006a3c0 2024-03-18T18:09:25.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf00b4920 con 0x7facf006a3c0 2024-03-18T18:09:25.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.983+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf00b51b0 con 0x7facf006a3c0 2024-03-18T18:09:25.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.987+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7facd8007450 con 0x7facf006a3c0 2024-03-18T18:09:25.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.987+0000 7face77fe700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7facd0066730 0x7facd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:25.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.987+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facd80836a0 con 0x7facf006a3c0 2024-03-18T18:09:25.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.987+0000 7facee7fc700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7facd0066730 0x7facd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:25.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.987+0000 7facee7fc700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7facd0066730 0x7facd0068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7face0009910 tx=0x7face0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:25.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:25.995+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7facf00b51b0 con 0x7facf006a3c0 2024-03-18T18:09:26.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.159+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facf00b51b0 con 0x7facf006a3c0 2024-03-18T18:09:26.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.159+0000 7face77fe700 1 -- 172.21.15.94:0/3608447689 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7facd8017020 con 0x7facf006a3c0 2024-03-18T18:09:26.162 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7facd0066730 msgr2=0x7facd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7facd0066730 0x7facd0068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7face0009910 tx=0x7face0008030 comp rx=0 tx=0).stop 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 msgr2=0x7facf0148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 0x7facf0148f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd800c500 tx=0x7facd800c8c0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 shutdown_connections 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7facd0066730 0x7facd0068bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf01dbb80 0x7facf01dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf009d630 0x7facf00b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 --2- 172.21.15.94:0/3608447689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7facf006a3c0 0x7facf0148f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 >> 172.21.15.94:0/3608447689 conn(0x7facf00bbda0 msgr2=0x7facf00ba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:26.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 shutdown_connections 2024-03-18T18:09:26.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.163+0000 7faceffff700 1 -- 172.21.15.94:0/3608447689 wait complete. 2024-03-18T18:09:26.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:09:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2f3b2700 1 Processor -- start 2024-03-18T18:09:26.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2f3b2700 1 -- start start 2024-03-18T18:09:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2f3b2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 0x7f2c280b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2f3b2700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c28147fe0 con 0x7f2c28070bd0 2024-03-18T18:09:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2f3b2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c28072910 con 0x7f2c2813df30 2024-03-18T18:09:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2f3b2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280b1cf0 con 0x7f2c28148470 2024-03-18T18:09:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2e3b0700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2c28070bd0 0x7f2c28072200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39784/0 (socket says 172.21.15.94:39784) 2024-03-18T18:09:26.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2e3b0700 1 -- 172.21.15.94:0/2535634787 learned_addr learned my addr 172.21.15.94:0/2535634787 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2dbaf700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 0x7f2c280b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450873430 0 0) 0x7f2c28147fe0 con 0x7f2c28070bd0 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.295+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c140035d0 con 0x7f2c28070bd0 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809267814 0 0) 0x7f2c28072910 con 0x7f2c2813df30 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c28147fe0 con 0x7f2c2813df30 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078008489 0 0) 0x7f2c140035d0 con 0x7f2c28070bd0 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 msgr2=0x7f2c280b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 0x7f2c280b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 >> v1:172.21.15.151:6789/0 conn(0x7f2c2813df30 legacy=0x7f2c2813e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28070fb0 con 0x7f2c28070bd0 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f2c24001670 con 0x7f2c28070bd0 2024-03-18T18:09:26.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 >> v1:172.21.15.94:6789/0 conn(0x7f2c28070bd0 legacy=0x7f2c28072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14003be0 0x7f2c14003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 0x7f2c14004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c14004db0 0x7f2c14005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280b1cf0 con 0x7f2c14004db0 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1400bbf0 con 0x7f2c14003be0 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1400bdb0 con 0x7f2c28148470 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c14004db0 0x7f2c14005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2e3b0700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14003be0 0x7f2c14003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 -- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 msgr2=0x7f2c14004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28148470 0x7f2c14004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 -- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14003be0 msgr2=0x7f2c14003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14003be0 0x7f2c14003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 -- 172.21.15.94:0/2535634787 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140035d0 con 0x7f2c14004db0 2024-03-18T18:09:26.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c14004db0 0x7f2c14005230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c2f0 tx=0x7f2c140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7796b0d2ae0cd8e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20001f30 con 0x7f2c14004db0 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000ce90 con 0x7f2c14004db0 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2d3ae700 1 -- 172.21.15.94:0/2535634787 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20003c60 con 0x7f2c14004db0 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/2535634787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c14004db0 msgr2=0x7f2c14005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/2535634787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c14004db0 0x7f2c14005230 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c2f0 tx=0x7f2c140058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2ebb1700 1 -- 172.21.15.94:0/2535634787 reap_dead start 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/2535634787 shutdown_connections 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/2535634787 >> 172.21.15.94:0/2535634787 conn(0x7f2c2806aac0 msgr2=0x7f2c280b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/2535634787 shutdown_connections 2024-03-18T18:09:26.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.299+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/2535634787 wait complete. 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 Processor -- start 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 -- start start 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 0x7f2c28141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c281db4f0 0x7f2c281db950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28144710 0x7f2c28144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281dbe90 con 0x7f2c28145bf0 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28145fd0 con 0x7f2c281db4f0 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28147310 con 0x7f2c28144710 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 0x7f2c28141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 0x7f2c28141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60976/0 (socket says 172.21.15.94:60976) 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 -- 172.21.15.94:0/1907847893 learned_addr learned my addr 172.21.15.94:0/1907847893 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2dbaf700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c281db4f0 0x7f2c281db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2ebb1700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28144710 0x7f2c28144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 -- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28144710 msgr2=0x7f2c28144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28144710 0x7f2c28144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 -- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c281db4f0 msgr2=0x7f2c281db950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c281db4f0 0x7f2c281db950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 -- 172.21.15.94:0/1907847893 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c281475f0 con 0x7f2c28145bf0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2ebb1700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28144710 0x7f2c28144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2e3b0700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 0x7f2c28141ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400e740 tx=0x7f2c2400ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24012590 con 0x7f2c28145bf0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c240126f0 con 0x7f2c28145bf0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c28146280 con 0x7f2c28145bf0 2024-03-18T18:09:26.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24012aa0 con 0x7f2c28145bf0 2024-03-18T18:09:26.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.303+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281454a0 con 0x7f2c28145bf0 2024-03-18T18:09:26.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.307+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28146470 con 0x7f2c28145bf0 2024-03-18T18:09:26.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.307+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2c24012c00 con 0x7f2c28145bf0 2024-03-18T18:09:26.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.307+0000 7f2c1affd700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2c0c066730 0x7f2c0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.307+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c24083fa0 con 0x7f2c28145bf0 2024-03-18T18:09:26.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.307+0000 7f2c2dbaf700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2c0c066730 0x7f2c0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.307+0000 7f2c2dbaf700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2c0c066730 0x7f2c0c068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c281dc620 tx=0x7f2c1c0093b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.315+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2c24054d40 con 0x7f2c28145bf0 2024-03-18T18:09:26.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.527+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c28074440 con 0x7f2c28145bf0 2024-03-18T18:09:26.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.527+0000 7f2c1affd700 1 -- 172.21.15.94:0/1907847893 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3210 (secure 0 0 0) 0x7f2c240548d0 con 0x7f2c28145bf0 2024-03-18T18:09:26.531 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:26.531 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T18:09:12.802236+0000","modified":"2024-03-18T18:09:14.818548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-18T18:09:26.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2c0c066730 msgr2=0x7f2c0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2c0c066730 0x7f2c0c068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c281dc620 tx=0x7f2c1c0093b0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 msgr2=0x7f2c28141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 0x7f2c28141ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400e740 tx=0x7f2c2400ea50 comp rx=0 tx=0).stop 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 shutdown_connections 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2c0c066730 0x7f2c0c068bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c28144710 0x7f2c28144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c281db4f0 0x7f2c281db950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 --2- 172.21.15.94:0/1907847893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2c28145bf0 0x7f2c28141ca0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 >> 172.21.15.94:0/1907847893 conn(0x7f2c2806aac0 msgr2=0x7f2c2813e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 shutdown_connections 2024-03-18T18:09:26.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.531+0000 7f2c2f3b2700 1 -- 172.21.15.94:0/1907847893 wait complete. 2024-03-18T18:09:26.535 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-03-18T18:09:26.545 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 Processor -- start 2024-03-18T18:09:26.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 -- start start 2024-03-18T18:09:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474146cb0 0x7f14740b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f14740b0850 0x7f1474150e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14740afd70 con 0x7f1474140830 2024-03-18T18:09:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14740ae700 con 0x7f14740b0850 2024-03-18T18:09:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1479f5c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14740affc0 con 0x7f1474146cb0 2024-03-18T18:09:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f14740b0850 0x7f1474150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f14740b0850 0x7f1474150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60980/0 (socket says 172.21.15.94:60980) 2024-03-18T18:09:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 -- 172.21.15.94:0/4226236326 learned_addr learned my addr 172.21.15.94:0/4226236326 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:26.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f1473fff700 1 --2- 172.21.15.94:0/4226236326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474146cb0 0x7f14740b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 -- 172.21.15.94:0/4226236326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474146cb0 msgr2=0x7f14740b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:26.659 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 --2- 172.21.15.94:0/4226236326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474146cb0 0x7f14740b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 -- 172.21.15.94:0/4226236326 >> v1:172.21.15.151:6789/0 conn(0x7f1474140830 legacy=0x7f14741465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f14737fe700 1 -- 172.21.15.94:0/4226236326 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972054861 0 0) 0x7f14740afd70 con 0x7f1474140830 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 -- 172.21.15.94:0/4226236326 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740b1a80 con 0x7f14740b0850 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f147975b700 1 --2- 172.21.15.94:0/4226236326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f1474150e60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1464009910 tx=0x7f1464009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8d63404eac78fa server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f14737fe700 1 -- 172.21.15.94:0/4226236326 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464011830 con 0x7f14740b0850 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f14737fe700 1 -- 172.21.15.94:0/4226236326 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1464011990 con 0x7f14740b0850 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.655+0000 7f14737fe700 1 -- 172.21.15.94:0/4226236326 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464011d40 con 0x7f14740b0850 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/4226236326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 msgr2=0x7f1474150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 --2- 172.21.15.94:0/4226236326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f1474150e60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1464009910 tx=0x7f1464009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/4226236326 shutdown_connections 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 --2- 172.21.15.94:0/4226236326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f1474150e60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 --2- 172.21.15.94:0/4226236326 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474146cb0 0x7f14740b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/4226236326 >> 172.21.15.94:0/4226236326 conn(0x7f14740b7a20 msgr2=0x7f14740b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:26.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/4226236326 shutdown_connections 2024-03-18T18:09:26.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/4226236326 wait complete. 2024-03-18T18:09:26.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 Processor -- start 2024-03-18T18:09:26.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- start start 2024-03-18T18:09:26.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f14741de980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474140830 0x7f14740ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1474146cb0 0x7f14740aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14741df640 con 0x7f14740b0850 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14741df080 con 0x7f1474146cb0 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14741df360 con 0x7f1474140830 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f14741de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f14741de980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:60994/0 (socket says 172.21.15.94:60994) 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 -- 172.21.15.94:0/3152344813 learned_addr learned my addr 172.21.15.94:0/3152344813 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f147975b700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1474146cb0 0x7f14740aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1473fff700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474140830 0x7f14740ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 -- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474140830 msgr2=0x7f14740ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474140830 0x7f14740ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 -- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1474146cb0 msgr2=0x7f14740aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1474146cb0 0x7f14740aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 -- 172.21.15.94:0/3152344813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464009570 con 0x7f14740b0850 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1473fff700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474140830 0x7f14740ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1478f5a700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f14741de980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14680011e0 tx=0x7f146800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680054e0 con 0x7f14740b0850 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14680036a0 con 0x7f14740b0850 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147411fb00 con 0x7f14740b0850 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468003a50 con 0x7f14740b0850 2024-03-18T18:09:26.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.659+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14740ab9d0 con 0x7f14740b0850 2024-03-18T18:09:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.663+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14740ac690 con 0x7f14740b0850 2024-03-18T18:09:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.663+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1468003bb0 con 0x7f14740b0850 2024-03-18T18:09:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.663+0000 7f14717fa700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1460066730 0x7f1460068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.663+0000 7f1473fff700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1460066730 0x7f1460068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.663+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1468083650 con 0x7f14740b0850 2024-03-18T18:09:26.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.663+0000 7f1473fff700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1460066730 0x7f1460068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14741d8dd0 tx=0x7f146c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.675+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f14740ac690 con 0x7f14740b0850 2024-03-18T18:09:26.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.843+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14740ac690 con 0x7f14740b0850 2024-03-18T18:09:26.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f14717fa700 1 -- 172.21.15.94:0/3152344813 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f14740ac690 con 0x7f14740b0850 2024-03-18T18:09:26.848 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:26.848 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":22,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:13.808682+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1460066730 msgr2=0x7f1460068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1460066730 0x7f1460068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14741d8dd0 tx=0x7f146c00b040 comp rx=0 tx=0).stop 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 msgr2=0x7f14741de980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f14741de980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14680011e0 tx=0x7f146800ca30 comp rx=0 tx=0).stop 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 shutdown_connections 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1460066730 0x7f1460068bf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1474146cb0 0x7f14740aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1474140830 0x7f14740ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 --2- 172.21.15.94:0/3152344813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f14740b0850 0x7f14741de980 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 >> 172.21.15.94:0/3152344813 conn(0x7f14740b7a20 msgr2=0x7f14740b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 shutdown_connections 2024-03-18T18:09:26.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.847+0000 7f1479f5c700 1 -- 172.21.15.94:0/3152344813 wait complete. 2024-03-18T18:09:26.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T18:08:58.619045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T18:09:10.506373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T18:09:11.785352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T18:09:26.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T18:09:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.975+0000 7fbe6566b700 1 Processor -- start 2024-03-18T18:09:26.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.975+0000 7fbe6566b700 1 -- start start 2024-03-18T18:09:26.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbe600b0920 0x7fbe60145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe601463e0 0x7fbe600b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600b01d0 con 0x7fbe600b1430 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe600b1cd0 con 0x7fbe600b0920 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600afa10 con 0x7fbe601463e0 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbe600b0920 0x7fbe60145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbe600b0920 0x7fbe60145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32772/0 (socket says 172.21.15.94:32772) 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1651289519 learned_addr learned my addr 172.21.15.94:0/1651289519 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:26.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe64e6a700 1 --2- 172.21.15.94:0/1651289519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe601463e0 0x7fbe600b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1651289519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe601463e0 msgr2=0x7fbe600b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 --2- 172.21.15.94:0/1651289519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe601463e0 0x7fbe600b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1651289519 >> v1:172.21.15.151:6789/0 conn(0x7fbe600b1430 legacy=0x7fbe60072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1651289519 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600afcb0 con 0x7fbe600b0920 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5effd700 1 -- 172.21.15.94:0/1651289519 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862649210 0 0) 0x7fbe600b01d0 con 0x7fbe600b1430 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5f7fe700 1 --2- 172.21.15.94:0/1651289519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b0920 0x7fbe60145ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009910 tx=0x7fbe54009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cd730f2346a8a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5effd700 1 -- 172.21.15.94:0/1651289519 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011830 con 0x7fbe600b0920 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5effd700 1 -- 172.21.15.94:0/1651289519 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54011990 con 0x7fbe600b0920 2024-03-18T18:09:26.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe5effd700 1 -- 172.21.15.94:0/1651289519 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011d40 con 0x7fbe600b0920 2024-03-18T18:09:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- 172.21.15.94:0/1651289519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b0920 msgr2=0x7fbe60145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1651289519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b0920 0x7fbe60145ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009910 tx=0x7fbe54009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:26.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- 172.21.15.94:0/1651289519 shutdown_connections 2024-03-18T18:09:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1651289519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe601463e0 0x7fbe600b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1651289519 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b0920 0x7fbe60145ea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- 172.21.15.94:0/1651289519 >> 172.21.15.94:0/1651289519 conn(0x7fbe600b4d70 msgr2=0x7fbe600b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- 172.21.15.94:0/1651289519 shutdown_connections 2024-03-18T18:09:26.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.979+0000 7fbe6566b700 1 -- 172.21.15.94:0/1651289519 wait complete. 2024-03-18T18:09:26.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 Processor -- start 2024-03-18T18:09:26.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 -- start start 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe600b0920 0x7fbe60139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 0x7fbe60141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe601463e0 0x7fbe60141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60139130 con 0x7fbe600b1430 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60139940 con 0x7fbe601463e0 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60142d60 con 0x7fbe600b0920 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 0x7fbe60141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 0x7fbe60141200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32788/0 (socket says 172.21.15.94:32788) 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1090158295 learned_addr learned my addr 172.21.15.94:0/1090158295 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe64e6a700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe601463e0 0x7fbe60141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5ffff700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe600b0920 0x7fbe60139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe600b0920 msgr2=0x7fbe60139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe600b0920 0x7fbe60139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe601463e0 msgr2=0x7fbe60141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe601463e0 0x7fbe60141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 -- 172.21.15.94:0/1090158295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54009570 con 0x7fbe600b1430 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5f7fe700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 0x7fbe60141200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009f70 tx=0x7fbe54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400b860 con 0x7fbe600b1430 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5401f070 con 0x7fbe600b1430 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe60139380 con 0x7fbe600b1430 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400bc20 con 0x7fbe600b1430 2024-03-18T18:09:26.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.983+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe60142a80 con 0x7fbe600b1430 2024-03-18T18:09:26.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.987+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe60074440 con 0x7fbe600b1430 2024-03-18T18:09:26.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.987+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbe54021030 con 0x7fbe600b1430 2024-03-18T18:09:26.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.987+0000 7fbe5cff9700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbe4c066760 0x7fbe4c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:26.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.987+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe54085410 con 0x7fbe600b1430 2024-03-18T18:09:26.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.987+0000 7fbe5ffff700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbe4c066760 0x7fbe4c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:26.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.987+0000 7fbe5ffff700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbe4c066760 0x7fbe4c068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe50000f60 tx=0x7fbe50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:26.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:26.995+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbe54052930 con 0x7fbe600b1430 2024-03-18T18:09:27.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.163+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe60140f20 con 0x7fbe600b1430 2024-03-18T18:09:27.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.163+0000 7fbe5cff9700 1 -- 172.21.15.94:0/1090158295 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe54006da0 con 0x7fbe600b1430 2024-03-18T18:09:27.166 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-03-18T18:09:27.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbe4c066760 msgr2=0x7fbe4c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbe4c066760 0x7fbe4c068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe50000f60 tx=0x7fbe50009040 comp rx=0 tx=0).stop 2024-03-18T18:09:27.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 msgr2=0x7fbe60141200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 0x7fbe60141200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009f70 tx=0x7fbe54004770 comp rx=0 tx=0).stop 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 shutdown_connections 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fbe4c066760 0x7fbe4c068c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe601463e0 0x7fbe60141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbe600b1430 0x7fbe60141200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 --2- 172.21.15.94:0/1090158295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe600b0920 0x7fbe60139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 >> 172.21.15.94:0/1090158295 conn(0x7fbe600b4d70 msgr2=0x7fbe600b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 shutdown_connections 2024-03-18T18:09:27.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.167+0000 7fbe6566b700 1 -- 172.21.15.94:0/1090158295 wait complete. 2024-03-18T18:09:27.180 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T18:09:27.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.295+0000 7f25bd61c700 1 Processor -- start 2024-03-18T18:09:27.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.295+0000 7f25bd61c700 1 -- start start 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f25b806a5c0 0x7f25b80b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b809ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b8141000 con 0x7f25b8146840 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80b7320 con 0x7f25b806a5c0 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80b6a60 con 0x7f25b806a9a0 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b6ffd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f25b806a5c0 0x7f25b80b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b77fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f25b8146840 0x7f25b8149db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39792/0 (socket says 172.21.15.94:39792) 2024-03-18T18:09:27.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b77fe700 1 -- 172.21.15.94:0/3609468351 learned_addr learned my addr 172.21.15.94:0/3609468351 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b67fc700 1 --2- 172.21.15.94:0/3609468351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b809ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b6ffd700 1 -- 172.21.15.94:0/3609468351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 msgr2=0x7f25b809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b6ffd700 1 --2- 172.21.15.94:0/3609468351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b809ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b6ffd700 1 -- 172.21.15.94:0/3609468351 >> v1:172.21.15.94:6789/0 conn(0x7f25b8146840 legacy=0x7f25b8149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b6ffd700 1 -- 172.21.15.94:0/3609468351 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80b6d40 con 0x7f25b806a5c0 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b5ffb700 1 -- 172.21.15.94:0/3609468351 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68217994 0 0) 0x7f25b8141000 con 0x7f25b8146840 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b6ffd700 1 --2- 172.21.15.94:0/3609468351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b806a5c0 0x7f25b80b8410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009850 tx=0x7f25a8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ee984886e6db91 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b5ffb700 1 -- 172.21.15.94:0/3609468351 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8011830 con 0x7f25b806a5c0 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b5ffb700 1 -- 172.21.15.94:0/3609468351 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8011990 con 0x7f25b806a5c0 2024-03-18T18:09:27.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25b5ffb700 1 -- 172.21.15.94:0/3609468351 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8011d40 con 0x7f25b806a5c0 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- 172.21.15.94:0/3609468351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b806a5c0 msgr2=0x7f25b80b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 --2- 172.21.15.94:0/3609468351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b806a5c0 0x7f25b80b8410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009850 tx=0x7f25a8009b60 comp rx=0 tx=0).stop 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- 172.21.15.94:0/3609468351 shutdown_connections 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 --2- 172.21.15.94:0/3609468351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b809ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 --2- 172.21.15.94:0/3609468351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b806a5c0 0x7f25b80b8410 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- 172.21.15.94:0/3609468351 >> 172.21.15.94:0/3609468351 conn(0x7f25b80bc040 msgr2=0x7f25b80bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- 172.21.15.94:0/3609468351 shutdown_connections 2024-03-18T18:09:27.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.299+0000 7f25bd61c700 1 -- 172.21.15.94:0/3609468351 wait complete. 2024-03-18T18:09:27.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 Processor -- start 2024-03-18T18:09:27.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 -- start start 2024-03-18T18:09:27.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b806a5c0 0x7f25b80ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b81df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 0x7f25b813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81dedd0 con 0x7f25b8146840 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b81dfd20 con 0x7f25b806a5c0 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80b3900 con 0x7f25b806a9a0 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 0x7f25b813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 0x7f25b813f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32806/0 (socket says 172.21.15.94:32806) 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 -- 172.21.15.94:0/4243536043 learned_addr learned my addr 172.21.15.94:0/4243536043 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b67fc700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b81df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b6ffd700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b806a5c0 0x7f25b80ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 -- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 msgr2=0x7f25b81df7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b81df7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 -- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b806a5c0 msgr2=0x7f25b80ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b806a5c0 0x7f25b80ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 -- 172.21.15.94:0/4243536043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80094b0 con 0x7f25b8146840 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b67fc700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b81df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:27.306 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b6ffd700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b806a5c0 0x7f25b80ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25b77fe700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 0x7f25b813f280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25b000cb60 tx=0x7f25b000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000ab50 con 0x7f25b8146840 2024-03-18T18:09:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b000acb0 con 0x7f25b8146840 2024-03-18T18:09:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0007310 con 0x7f25b8146840 2024-03-18T18:09:27.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b80b3be0 con 0x7f25b8146840 2024-03-18T18:09:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.303+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b81df2c0 con 0x7f25b8146840 2024-03-18T18:09:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.307+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b8068310 con 0x7f25b8146840 2024-03-18T18:09:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.307+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f25b0007470 con 0x7f25b8146840 2024-03-18T18:09:27.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.307+0000 7f25af7fe700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2598066730 0x7f2598068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.307+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b0083cd0 con 0x7f25b8146840 2024-03-18T18:09:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.307+0000 7f25b6ffd700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2598066730 0x7f2598068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.307+0000 7f25b6ffd700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2598066730 0x7f2598068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009ba0 tx=0x7f25a8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.315+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f25b0051050 con 0x7f25b8146840 2024-03-18T18:09:27.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.487+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25b8145470 con 0x7f25b8146840 2024-03-18T18:09:27.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.487+0000 7f25af7fe700 1 -- 172.21.15.94:0/4243536043 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25b00180a0 con 0x7f25b8146840 2024-03-18T18:09:27.489 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-03-18T18:09:27.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2598066730 msgr2=0x7f2598068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2598066730 0x7f2598068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009ba0 tx=0x7f25a8008030 comp rx=0 tx=0).stop 2024-03-18T18:09:27.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 msgr2=0x7f25b813f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 0x7f25b813f280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25b000cb60 tx=0x7f25b000cf20 comp rx=0 tx=0).stop 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 shutdown_connections 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2598066730 0x7f2598068bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f25b8146840 0x7f25b813f280 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b806a9a0 0x7f25b81df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 --2- 172.21.15.94:0/4243536043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b806a5c0 0x7f25b80ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 >> 172.21.15.94:0/4243536043 conn(0x7f25b80bc040 msgr2=0x7f25b81447b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 shutdown_connections 2024-03-18T18:09:27.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.491+0000 7f25bd61c700 1 -- 172.21.15.94:0/4243536043 wait complete. 2024-03-18T18:09:27.508 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T18:09:27.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 Processor -- start 2024-03-18T18:09:27.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- start start 2024-03-18T18:09:27.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd18c0b8620 0x7fd18c071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c072260 0x7fd18c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c06ebe0 con 0x7fd18c145010 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c1454c0 con 0x7fd18c0b8620 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b8a00 con 0x7fd18c072260 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd18c0b8620 0x7fd18c071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd18c0b8620 0x7fd18c071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32818/0 (socket says 172.21.15.94:32818) 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 -- 172.21.15.94:0/928678277 learned_addr learned my addr 172.21.15.94:0/928678277 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:27.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18b7fe700 1 --2- 172.21.15.94:0/928678277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c072260 0x7fd18c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 -- 172.21.15.94:0/928678277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c072260 msgr2=0x7fd18c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 --2- 172.21.15.94:0/928678277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c072260 0x7fd18c144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 -- 172.21.15.94:0/928678277 >> v1:172.21.15.151:6789/0 conn(0x7fd18c145010 legacy=0x7fd18c147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 -- 172.21.15.94:0/928678277 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c06ee30 con 0x7fd18c0b8620 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18bfff700 1 --2- 172.21.15.94:0/928678277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c0b8620 0x7fd18c071d20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009910 tx=0x7fd17c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c659053b636c0fff server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18affd700 1 -- 172.21.15.94:0/928678277 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c011830 con 0x7fd18c0b8620 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18affd700 1 -- 172.21.15.94:0/928678277 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c011990 con 0x7fd18c0b8620 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd18affd700 1 -- 172.21.15.94:0/928678277 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c011d40 con 0x7fd18c0b8620 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- 172.21.15.94:0/928678277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c0b8620 msgr2=0x7fd18c071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 --2- 172.21.15.94:0/928678277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c0b8620 0x7fd18c071d20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009910 tx=0x7fd17c009c20 comp rx=0 tx=0).stop 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- 172.21.15.94:0/928678277 shutdown_connections 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 --2- 172.21.15.94:0/928678277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c072260 0x7fd18c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 --2- 172.21.15.94:0/928678277 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c0b8620 0x7fd18c071d20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- 172.21.15.94:0/928678277 >> 172.21.15.94:0/928678277 conn(0x7fd18c06a780 msgr2=0x7fd18c0b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:27.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- 172.21.15.94:0/928678277 shutdown_connections 2024-03-18T18:09:27.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.623+0000 7fd192a18700 1 -- 172.21.15.94:0/928678277 wait complete. 2024-03-18T18:09:27.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 Processor -- start 2024-03-18T18:09:27.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 -- start start 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 0x7fd18c1da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c0b8620 0x7fd18c0a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd18c145010 0x7fd18c0a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0ae5b0 con 0x7fd18c072260 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0ab1f0 con 0x7fd18c145010 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c1d9af0 con 0x7fd18c0b8620 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 0x7fd18c1da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 0x7fd18c1da5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32820/0 (socket says 172.21.15.94:32820) 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 -- 172.21.15.94:0/422845267 learned_addr learned my addr 172.21.15.94:0/422845267 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18b7fe700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c0b8620 0x7fd18c0a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd190fb5700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd18c145010 0x7fd18c0a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 -- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c0b8620 msgr2=0x7fd18c0a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c0b8620 0x7fd18c0a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 -- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd18c145010 msgr2=0x7fd18c0a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd18c145010 0x7fd18c0a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 -- 172.21.15.94:0/422845267 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c009570 con 0x7fd18c072260 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd18bfff700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 0x7fd18c1da5d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009c60 tx=0x7fd17c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c004300 con 0x7fd18c072260 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c01f070 con 0x7fd18c072260 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c1d9dd0 con 0x7fd18c072260 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0036c0 con 0x7fd18c072260 2024-03-18T18:09:27.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.627+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c141900 con 0x7fd18c072260 2024-03-18T18:09:27.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.631+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c06e850 con 0x7fd18c072260 2024-03-18T18:09:27.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.631+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd17c021030 con 0x7fd18c072260 2024-03-18T18:09:27.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.631+0000 7fd188ff9700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd178066760 0x7fd178068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.631+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd17c085350 con 0x7fd18c072260 2024-03-18T18:09:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.631+0000 7fd18b7fe700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd178066760 0x7fd178068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.635+0000 7fd18b7fe700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd178066760 0x7fd178068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0b8320 tx=0x7fd180009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.639+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd18c06e850 con 0x7fd18c072260 2024-03-18T18:09:27.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd18c1da2f0 con 0x7fd18c072260 2024-03-18T18:09:27.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd188ff9700 1 -- 172.21.15.94:0/422845267 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd18c1da2f0 con 0x7fd18c072260 2024-03-18T18:09:27.808 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-03-18T18:09:27.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd178066760 msgr2=0x7fd178068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd178066760 0x7fd178068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0b8320 tx=0x7fd180009240 comp rx=0 tx=0).stop 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 msgr2=0x7fd18c1da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 0x7fd18c1da5d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009c60 tx=0x7fd17c004770 comp rx=0 tx=0).stop 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 shutdown_connections 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd178066760 0x7fd178068c20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd18c145010 0x7fd18c0a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd18c0b8620 0x7fd18c0a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 --2- 172.21.15.94:0/422845267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd18c072260 0x7fd18c1da5d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 >> 172.21.15.94:0/422845267 conn(0x7fd18c06a780 msgr2=0x7fd18c1424d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 shutdown_connections 2024-03-18T18:09:27.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.807+0000 7fd192a18700 1 -- 172.21.15.94:0/422845267 wait complete. 2024-03-18T18:09:27.823 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:09:27.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd24bfff700 1 Processor -- start 2024-03-18T18:09:27.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd24bfff700 1 -- start start 2024-03-18T18:09:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd24bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd24c06cad0 0x7fd24c06f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd24bfff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0b3c90 con 0x7fd24c0712e0 2024-03-18T18:09:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd24bfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c0b4250 con 0x7fd24c071770 2024-03-18T18:09:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd24bfff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c06ceb0 con 0x7fd24c06cad0 2024-03-18T18:09:27.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd2427fc700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd24c0712e0 0x7fd24c140460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39804/0 (socket says 172.21.15.94:39804) 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.931+0000 7fd2427fc700 1 -- 172.21.15.94:0/3100917962 learned_addr learned my addr 172.21.15.94:0/3100917962 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24affd700 1 --2- 172.21.15.94:0/3100917962 >> v2:172.21.15.151:3300/0 conn(0x7fd24c06cad0 0x7fd24c06f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600506053 0 0) 0x7fd24c0b3c90 con 0x7fd24c0712e0 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2380035d0 con 0x7fd24c0712e0 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917818101 0 0) 0x7fd2380035d0 con 0x7fd24c0712e0 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 >> v2:172.21.15.151:3300/0 conn(0x7fd24c06cad0 msgr2=0x7fd24c06f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 --2- 172.21.15.94:0/3100917962 >> v2:172.21.15.151:3300/0 conn(0x7fd24c06cad0 0x7fd24c06f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 >> v1:172.21.15.151:6789/0 conn(0x7fd24c071770 legacy=0x7fd24c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0b3ee0 con 0x7fd24c0712e0 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7fd234001670 con 0x7fd24c0712e0 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 >> v1:172.21.15.94:6789/0 conn(0x7fd24c0712e0 legacy=0x7fd24c140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd238003a20 0x7fd238003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd238004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd238005230 0x7fd23800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c06ceb0 con 0x7fd238004870 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800c1d0 con 0x7fd238003a20 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800c390 con 0x7fd238005230 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd238004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24affd700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd238003a20 0x7fd238003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24b7fe700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd238005230 0x7fd23800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 -- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd238005230 msgr2=0x7fd23800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd238005230 0x7fd23800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 -- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd238003a20 msgr2=0x7fd238003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:27.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd238003a20 0x7fd238003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24b7fe700 1 -- 172.21.15.94:0/3100917962 reap_dead start 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 -- 172.21.15.94:0/3100917962 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380035d0 con 0x7fd238004870 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24affd700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd238003a20 0x7fd238003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd2427fc700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd238004cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c320 tx=0x7fd2380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5143b84c24e383ec server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234007c30 con 0x7fd238004870 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400ce20 con 0x7fd238004870 2024-03-18T18:09:27.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24a7fc700 1 -- 172.21.15.94:0/3100917962 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234005bc0 con 0x7fd238004870 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 -- 172.21.15.94:0/3100917962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 msgr2=0x7fd238004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd238004cf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c320 tx=0x7fd2380058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 -- 172.21.15.94:0/3100917962 shutdown_connections 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 --2- 172.21.15.94:0/3100917962 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd238004cf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 -- 172.21.15.94:0/3100917962 >> 172.21.15.94:0/3100917962 conn(0x7fd24c0b5610 msgr2=0x7fd24c0b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 -- 172.21.15.94:0/3100917962 shutdown_connections 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.935+0000 7fd24bfff700 1 -- 172.21.15.94:0/3100917962 wait complete. 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 Processor -- start 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- start start 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd24c140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24c0afe50 0x7fd24c13fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c0b2cd0 0x7fd24c13b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1405c0 con 0x7fd238004870 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1411f0 con 0x7fd24c0b2cd0 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c140270 con 0x7fd24c0afe50 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd24c140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd24c140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32832/0 (socket says 172.21.15.94:32832) 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 -- 172.21.15.94:0/427137271 learned_addr learned my addr 172.21.15.94:0/427137271 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24b7fe700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c0b2cd0 0x7fd24c13b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd2427fc700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24c0afe50 0x7fd24c13fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 -- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24c0afe50 msgr2=0x7fd24c13fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24c0afe50 0x7fd24c13fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 -- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c0b2cd0 msgr2=0x7fd24c13b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:27.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c0b2cd0 0x7fd24c13b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 -- 172.21.15.94:0/427137271 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c141410 con 0x7fd238004870 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd2427fc700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24c0afe50 0x7fd24c13fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24affd700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd24c140cb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd23c011c00 tx=0x7fd23c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00f9e0 con 0x7fd238004870 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00fb40 con 0x7fd238004870 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c1416f0 con 0x7fd238004870 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00fed0 con 0x7fd238004870 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0b3180 con 0x7fd238004870 2024-03-18T18:09:27.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.939+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c143bc0 con 0x7fd238004870 2024-03-18T18:09:27.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.943+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd23c004020 con 0x7fd238004870 2024-03-18T18:09:27.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.943+0000 7fd248ff9700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd22c066730 0x7fd22c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:27.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.943+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd23c084440 con 0x7fd238004870 2024-03-18T18:09:27.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.943+0000 7fd2427fc700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd22c066730 0x7fd22c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:27.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.943+0000 7fd2427fc700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd22c066730 0x7fd22c068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd234001930 tx=0x7fd234007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:27.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:27.951+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd23c051840 con 0x7fd238004870 2024-03-18T18:09:28.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd24c0afad0 con 0x7fd238004870 2024-03-18T18:09:28.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd248ff9700 1 -- 172.21.15.94:0/427137271 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3210 (secure 0 0 0) 0x7fd23c022090 con 0x7fd238004870 2024-03-18T18:09:28.160 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:28.160 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T18:09:12.802236+0000","modified":"2024-03-18T18:09:14.818548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd22c066730 msgr2=0x7fd22c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd22c066730 0x7fd22c068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd234001930 tx=0x7fd234007000 comp rx=0 tx=0).stop 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 msgr2=0x7fd24c140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd24c140cb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd23c011c00 tx=0x7fd23c011f10 comp rx=0 tx=0).stop 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 shutdown_connections 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd22c066730 0x7fd22c068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c0b2cd0 0x7fd24c13b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24c0afe50 0x7fd24c13fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 --2- 172.21.15.94:0/427137271 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd238004870 0x7fd24c140cb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.159+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 >> 172.21.15.94:0/427137271 conn(0x7fd24c0b5610 msgr2=0x7fd24c146480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.163+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 shutdown_connections 2024-03-18T18:09:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.163+0000 7fd24bfff700 1 -- 172.21.15.94:0/427137271 wait complete. 2024-03-18T18:09:28.164 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-03-18T18:09:28.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:09:28.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.279+0000 7f87e138f700 1 Processor -- start 2024-03-18T18:09:28.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.279+0000 7f87e138f700 1 -- start start 2024-03-18T18:09:28.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e138f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 0x7f87dc0b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e138f700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0b9be0 con 0x7f87dc140b00 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e138f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0ba110 con 0x7f87dc09ac60 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e138f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc09b040 con 0x7f87dc0b8270 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87db7fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f87dc140b00 0x7f87dc14eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39808/0 (socket says 172.21.15.94:39808) 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87db7fe700 1 -- 172.21.15.94:0/199922834 learned_addr learned my addr 172.21.15.94:0/199922834 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 0x7f87dc0b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228008449 0 0) 0x7f87dc0b9be0 con 0x7f87dc140b00 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c40035d0 con 0x7f87dc140b00 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856700460 0 0) 0x7f87c40035d0 con 0x7f87dc140b00 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 msgr2=0x7f87dc0b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 0x7f87dc0b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 >> v1:172.21.15.151:6789/0 conn(0x7f87dc09ac60 legacy=0x7f87dc1403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0b9e30 con 0x7f87dc140b00 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f87cc001670 con 0x7f87dc140b00 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 >> v1:172.21.15.94:6789/0 conn(0x7f87dc140b00 legacy=0x7f87dc14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 0x7f87c4003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4003f90 0x7f87c4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c4004db0 0x7f87c4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc09b040 con 0x7f87c4004db0 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c400bbf0 con 0x7f87c4003f90 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c400bdb0 con 0x7f87dc0b8270 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c4004db0 0x7f87c4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87dbfff700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 0x7f87c4003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87db7fe700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4003f90 0x7f87c4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 -- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 msgr2=0x7f87c4003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc0b8270 0x7f87c4003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 -- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4003f90 msgr2=0x7f87c4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4003f90 0x7f87c4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 -- 172.21.15.94:0/199922834 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c40035d0 con 0x7f87c4004db0 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87db7fe700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4003f90 0x7f87c4004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c4004db0 0x7f87c4005230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009fc0 tx=0x7f87c40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94547b7f9ba0550c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400ec30 con 0x7f87c4004db0 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400f040 con 0x7f87c4004db0 2024-03-18T18:09:28.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.283+0000 7f87daffd700 1 -- 172.21.15.94:0/199922834 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4014480 con 0x7f87c4004db0 2024-03-18T18:09:28.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- 172.21.15.94:0/199922834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c4004db0 msgr2=0x7f87c4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 --2- 172.21.15.94:0/199922834 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87c4004db0 0x7f87c4005230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009fc0 tx=0x7f87c40058a0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 -- 172.21.15.94:0/199922834 reap_dead start 2024-03-18T18:09:28.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- 172.21.15.94:0/199922834 shutdown_connections 2024-03-18T18:09:28.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- 172.21.15.94:0/199922834 >> 172.21.15.94:0/199922834 conn(0x7f87dc09dbf0 msgr2=0x7f87dc09dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:28.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- 172.21.15.94:0/199922834 shutdown_connections 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- 172.21.15.94:0/199922834 wait complete. 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 Processor -- start 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- start start 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4004db0 0x7f87dc139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc1444c0 0x7f87dc09ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 0x7f87dc14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc138f30 con 0x7f87dc09cfc0 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc1dec50 con 0x7f87c4004db0 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e138f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc1def30 con 0x7f87dc1444c0 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 0x7f87dc14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87dbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4004db0 0x7f87dc139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 0x7f87dc14a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32848/0 (socket says 172.21.15.94:32848) 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87dbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4004db0 0x7f87dc139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:38736/0 (socket says 172.21.15.94:38736) 2024-03-18T18:09:28.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 -- 172.21.15.94:0/1761451201 learned_addr learned my addr 172.21.15.94:0/1761451201 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87db7fe700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc1444c0 0x7f87dc09ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 -- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc1444c0 msgr2=0x7f87dc09ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc1444c0 0x7f87dc09ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 -- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4004db0 msgr2=0x7f87dc139610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4004db0 0x7f87dc139610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 -- 172.21.15.94:0/1761451201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc1df210 con 0x7f87dc09cfc0 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.287+0000 7f87e0b8e700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 0x7f87dc14a1b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87d4017040 tx=0x7f87d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4007000 con 0x7f87dc09cfc0 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4003e70 con 0x7f87dc09cfc0 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc1df730 con 0x7f87dc09cfc0 2024-03-18T18:09:28.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d40149d0 con 0x7f87dc09cfc0 2024-03-18T18:09:28.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc144940 con 0x7f87dc09cfc0 2024-03-18T18:09:28.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc067620 con 0x7f87dc09cfc0 2024-03-18T18:09:28.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.291+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87d4023020 con 0x7f87dc09cfc0 2024-03-18T18:09:28.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.295+0000 7f87d8ff9700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c8066760 0x7f87c8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.295+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87d40853c0 con 0x7f87dc09cfc0 2024-03-18T18:09:28.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.295+0000 7f87dbfff700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c8066760 0x7f87c8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.295+0000 7f87dbfff700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c8066760 0x7f87c8068c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87d0007fd0 tx=0x7f87d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:28.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.299+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f87d40527c0 con 0x7f87dc09cfc0 2024-03-18T18:09:28.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.475+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87dc1dea50 con 0x7f87dc09cfc0 2024-03-18T18:09:28.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.479+0000 7f87d8ff9700 1 -- 172.21.15.94:0/1761451201 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f87d4055de0 con 0x7f87dc09cfc0 2024-03-18T18:09:28.482 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:28.482 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":22,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:09:13.808682+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:09:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c8066760 msgr2=0x7f87c8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c8066760 0x7f87c8068c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87d0007fd0 tx=0x7f87d0009040 comp rx=0 tx=0).stop 2024-03-18T18:09:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 msgr2=0x7f87dc14a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 0x7f87dc14a1b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87d4017040 tx=0x7f87d4009750 comp rx=0 tx=0).stop 2024-03-18T18:09:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 shutdown_connections 2024-03-18T18:09:28.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f87c8066760 0x7f87c8068c20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f87dc09cfc0 0x7f87dc14a1b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87dc1444c0 0x7f87dc09ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 --2- 172.21.15.94:0/1761451201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c4004db0 0x7f87dc139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 >> 172.21.15.94:0/1761451201 conn(0x7f87dc09dbf0 msgr2=0x7f87dc13e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:28.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 shutdown_connections 2024-03-18T18:09:28.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.483+0000 7f87e138f700 1 -- 172.21.15.94:0/1761451201 wait complete. 2024-03-18T18:09:28.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:09:28.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 Processor -- start 2024-03-18T18:09:28.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 -- start start 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16140abed0 0x7f16140afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 0x7f16140aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16140b4870 con 0x7f16140b57e0 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140acb30 con 0x7f16140abed0 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f161a7ce700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16140ac8c0 con 0x7f16140b0e00 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f1618d6b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 0x7f16140aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f16137fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16140abed0 0x7f16140afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f1618d6b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 0x7f16140aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:53894/0 (socket says 172.21.15.94:53894) 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f16137fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16140abed0 0x7f16140afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:38750/0 (socket says 172.21.15.94:38750) 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f1613fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f16140b57e0 0x7f16140b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:45494/0 (socket says 172.21.15.94:45494) 2024-03-18T18:09:28.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.611+0000 7f1618d6b700 1 -- 172.21.15.94:0/1590869973 learned_addr learned my addr 172.21.15.94:0/1590869973 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1618d6b700 1 -- 172.21.15.94:0/1590869973 >> v2:172.21.15.151:3300/0 conn(0x7f16140abed0 msgr2=0x7f16140afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1618d6b700 1 --2- 172.21.15.94:0/1590869973 >> v2:172.21.15.151:3300/0 conn(0x7f16140abed0 0x7f16140afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1618d6b700 1 -- 172.21.15.94:0/1590869973 >> v1:172.21.15.151:6789/0 conn(0x7f16140b57e0 legacy=0x7f16140b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1618d6b700 1 -- 172.21.15.94:0/1590869973 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140b15e0 con 0x7f16140b0e00 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1618d6b700 1 --2- 172.21.15.94:0/1590869973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 0x7f16140aff90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f160c00d150 tx=0x7f160c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5126a3f43b3fbc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1612ffd700 1 -- 172.21.15.94:0/1590869973 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c010070 con 0x7f16140b0e00 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1612ffd700 1 -- 172.21.15.94:0/1590869973 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00dd10 con 0x7f16140b0e00 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f1612ffd700 1 -- 172.21.15.94:0/1590869973 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00b310 con 0x7f16140b0e00 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 -- 172.21.15.94:0/1590869973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 msgr2=0x7f16140aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 --2- 172.21.15.94:0/1590869973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 0x7f16140aff90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f160c00d150 tx=0x7f160c00d460 comp rx=0 tx=0).stop 2024-03-18T18:09:28.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 -- 172.21.15.94:0/1590869973 shutdown_connections 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 --2- 172.21.15.94:0/1590869973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16140b0e00 0x7f16140aff90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 --2- 172.21.15.94:0/1590869973 >> v2:172.21.15.151:3300/0 conn(0x7f16140abed0 0x7f16140afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 -- 172.21.15.94:0/1590869973 >> 172.21.15.94:0/1590869973 conn(0x7f16140b91a0 msgr2=0x7f16140b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 -- 172.21.15.94:0/1590869973 shutdown_connections 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 -- 172.21.15.94:0/1590869973 wait complete. 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 Processor -- start 2024-03-18T18:09:28.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.615+0000 7f161a7ce700 1 -- start start 2024-03-18T18:09:28.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16140b0e00 0x7f16140a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16140b57e0 0x7f16140afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1614072310 0x7f16141c1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16140aa8f0 con 0x7f16140b0e00 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16140aabd0 con 0x7f16140b57e0 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16140ab190 con 0x7f1614072310 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1613fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16140b0e00 0x7f16140a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f16137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16140b57e0 0x7f16140afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1614072310 0x7f16141c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1613fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16140b0e00 0x7f16140a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32858/0 (socket says 172.21.15.94:32858) 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f16137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16140b57e0 0x7f16140afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:38754/0 (socket says 172.21.15.94:38754) 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1613fff700 1 -- 172.21.15.94:0/493559509 learned_addr learned my addr 172.21.15.94:0/493559509 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 -- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16140b57e0 msgr2=0x7f16140afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16140b57e0 0x7f16140afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 -- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16140b0e00 msgr2=0x7f16140a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16140b0e00 0x7f16140a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 -- 172.21.15.94:0/493559509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c00bd40 con 0x7f1614072310 2024-03-18T18:09:28.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1618d6b700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1614072310 0x7f16141c1160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f160c017000 tx=0x7f160c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:28.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00bbc0 con 0x7f1614072310 2024-03-18T18:09:28.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00b4c0 con 0x7f1614072310 2024-03-18T18:09:28.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16141ccec0 con 0x7f1614072310 2024-03-18T18:09:28.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00ae70 con 0x7f1614072310 2024-03-18T18:09:28.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16140a8770 con 0x7f1614072310 2024-03-18T18:09:28.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.619+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16141ccd20 con 0x7f1614072310 2024-03-18T18:09:28.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.623+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f160c00a030 con 0x7f1614072310 2024-03-18T18:09:28.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.623+0000 7f1610ff9700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1600066730 0x7f1600068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:28.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.623+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f160c087790 con 0x7f1614072310 2024-03-18T18:09:28.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.623+0000 7f1613fff700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1600066730 0x7f1600068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:28.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.623+0000 7f1613fff700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1600066730 0x7f1600068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1604000f60 tx=0x7f1604001190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:28.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.631+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f160c054af0 con 0x7f1614072310 2024-03-18T18:09:28.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.839+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16140a8490 con 0x7f1614072310 2024-03-18T18:09:28.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.839+0000 7f1610ff9700 1 -- 172.21.15.94:0/493559509 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3210 (secure 0 0 0) 0x7f16140a8490 con 0x7f1614072310 2024-03-18T18:09:28.842 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:09:28.842 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T18:09:12.802236+0000","modified":"2024-03-18T18:09:14.818548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1600066730 msgr2=0x7f1600068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1600066730 0x7f1600068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1604000f60 tx=0x7f1604001190 comp rx=0 tx=0).stop 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1614072310 msgr2=0x7f16141c1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1614072310 0x7f16141c1160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f160c017000 tx=0x7f160c004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 shutdown_connections 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1600066730 0x7f1600068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1614072310 0x7f16141c1160 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16140b57e0 0x7f16140afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 --2- 172.21.15.94:0/493559509 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16140b0e00 0x7f16140a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 >> 172.21.15.94:0/493559509 conn(0x7f16140b91a0 msgr2=0x7f16140b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 shutdown_connections 2024-03-18T18:09:28.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:28.843+0000 7f161a7ce700 1 -- 172.21.15.94:0/493559509 wait complete. 2024-03-18T18:09:28.847 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-03-18T18:09:29.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T18:09:12.802236+0000', 'modified': '2024-03-18T18:09:14.818548+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6833/1854308487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1854308487}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1854308487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-18T18:09:29.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T18:09:29.060 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-18T18:09:29.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 Processor -- start 2024-03-18T18:09:29.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- start start 2024-03-18T18:09:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb0806a3c0 0x7fdb08146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb080b6c80 0x7fdb080b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb0809d630 0x7fdb0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080b7620 con 0x7fdb0809d630 2024-03-18T18:09:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080b8590 con 0x7fdb0806a3c0 2024-03-18T18:09:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081472c0 con 0x7fdb080b6c80 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb0809d630 0x7fdb0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdb0809d630 0x7fdb0809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32860/0 (socket says 172.21.15.94:32860) 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 -- 172.21.15.94:0/1721570978 learned_addr learned my addr 172.21.15.94:0/1721570978 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb077fe700 1 --2- 172.21.15.94:0/1721570978 >> v2:172.21.15.151:3300/0 conn(0x7fdb0806a3c0 0x7fdb08146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb080b6c80 0x7fdb080b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 -- 172.21.15.94:0/1721570978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb080b6c80 msgr2=0x7fdb080b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb080b6c80 0x7fdb080b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 -- 172.21.15.94:0/1721570978 >> v2:172.21.15.151:3300/0 conn(0x7fdb0806a3c0 msgr2=0x7fdb08146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 --2- 172.21.15.94:0/1721570978 >> v2:172.21.15.151:3300/0 conn(0x7fdb0806a3c0 0x7fdb08146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 -- 172.21.15.94:0/1721570978 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0809bb60 con 0x7fdb0809d630 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb080b6c80 0x7fdb080b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb07fff700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb0809d630 0x7fdb0809dac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdb080bce20 tx=0x7fdb0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb253e2ba79749e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb067fc700 1 -- 172.21.15.94:0/1721570978 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000e070 con 0x7fdb0809d630 2024-03-18T18:09:29.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb067fc700 1 -- 172.21.15.94:0/1721570978 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000b910 con 0x7fdb0809d630 2024-03-18T18:09:29.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb067fc700 1 -- 172.21.15.94:0/1721570978 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000bcc0 con 0x7fdb0809d630 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/1721570978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb0809d630 msgr2=0x7fdb0809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb0809d630 0x7fdb0809dac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdb080bce20 tx=0x7fdb0000b330 comp rx=0 tx=0).stop 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/1721570978 shutdown_connections 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb0809d630 0x7fdb0809dac0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/1721570978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb080b6c80 0x7fdb080b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/1721570978 >> v2:172.21.15.151:3300/0 conn(0x7fdb0806a3c0 0x7fdb08146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/1721570978 >> 172.21.15.94:0/1721570978 conn(0x7fdb080bbda0 msgr2=0x7fdb080bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/1721570978 shutdown_connections 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.183+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/1721570978 wait complete. 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 Processor -- start 2024-03-18T18:09:29.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 -- start start 2024-03-18T18:09:29.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb0806a3c0 0x7fdb08145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb0809d630 0x7fdb080b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 0x7fdb080b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080a1010 con 0x7fdb080b6c80 2024-03-18T18:09:29.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080b10b0 con 0x7fdb0809d630 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080a12f0 con 0x7fdb0806a3c0 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 0x7fdb080b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 0x7fdb080b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32872/0 (socket says 172.21.15.94:32872) 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 -- 172.21.15.94:0/4203173619 learned_addr learned my addr 172.21.15.94:0/4203173619 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb0809d630 0x7fdb080b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb077fe700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb0806a3c0 0x7fdb08145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 -- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb0806a3c0 msgr2=0x7fdb08145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb0806a3c0 0x7fdb08145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 -- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb0809d630 msgr2=0x7fdb080b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb0809d630 0x7fdb080b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 -- 172.21.15.94:0/4203173619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009b30 con 0x7fdb080b6c80 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb07fff700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 0x7fdb080b1b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806abe0 tx=0x7fdb00004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdaeffff700 1 -- 172.21.15.94:0/4203173619 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000099b0 con 0x7fdb080b6c80 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdaeffff700 1 -- 172.21.15.94:0/4203173619 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb000092e0 con 0x7fdb080b6c80 2024-03-18T18:09:29.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb080b2650 con 0x7fdb080b6c80 2024-03-18T18:09:29.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdaeffff700 1 -- 172.21.15.94:0/4203173619 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00004470 con 0x7fdb080b6c80 2024-03-18T18:09:29.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.187+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb080a0a20 con 0x7fdb080b6c80 2024-03-18T18:09:29.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdaeffff700 1 -- 172.21.15.94:0/4203173619 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdb000045d0 con 0x7fdb080b6c80 2024-03-18T18:09:29.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdaeffff700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdaf4066730 0x7fdaf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdaeffff700 1 -- 172.21.15.94:0/4203173619 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb00085500 con 0x7fdb080b6c80 2024-03-18T18:09:29.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb077fe700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdaf4066730 0x7fdaf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 Processor -- start 2024-03-18T18:09:29.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 -- start start 2024-03-18T18:09:29.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb077fe700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdaf4066730 0x7fdaf4068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009bf0 tx=0x7fdaf8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80b70 0xea94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xea4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xea4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0xded2d0 con 0xe80f50 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0xdeaa60 con 0xea4690 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0xde6350 con 0xe80b70 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xea4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xea4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32878/0 (socket says 172.21.15.94:32878) 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2240095102 learned_addr learned my addr 172.21.15.94:0/2240095102 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb077fe700 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80b70 0xea94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.191+0000 7fdb07fff700 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xea4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80b70 msgr2=0xea94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80b70 0xea94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 msgr2=0xea4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xea4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2240095102 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc59960 con 0xe80f50 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xea4150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0045f0 tx=0x7fdafc0039a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2700fd30c80e3ed server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdaed7fa700 1 -- 172.21.15.94:0/2240095102 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0097b0 con 0xe80f50 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdaed7fa700 1 -- 172.21.15.94:0/2240095102 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc009910 con 0xe80f50 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdaed7fa700 1 -- 172.21.15.94:0/2240095102 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc009c80 con 0xe80f50 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- 172.21.15.94:0/2240095102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 msgr2=0xea4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xea4150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0045f0 tx=0x7fdafc0039a0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- 172.21.15.94:0/2240095102 shutdown_connections 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xea4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xea4150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2240095102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80b70 0xea94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- 172.21.15.94:0/2240095102 >> 172.21.15.94:0/2240095102 conn(0xc0e4d0 msgr2=0xea8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:29.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- 172.21.15.94:0/2240095102 shutdown_connections 2024-03-18T18:09:29.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- 172.21.15.94:0/2240095102 wait complete. 2024-03-18T18:09:29.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- start start 2024-03-18T18:09:29.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 Processor -- start 2024-03-18T18:09:29.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80b70 0xe92a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xe92f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xe93490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0xda3c80 con 0xe80f50 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0xda9b00 con 0xe80b70 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0xc92aa0 con 0xea4690 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb1148f740 10 client.0 _ll_register_callbacks cb 0xdab030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xe92f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xe92f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32888/0 (socket says 172.21.15.94:32888) 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2110047174 learned_addr learned my addr 172.21.15.94:0/2110047174 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb07fff700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xe93490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.195+0000 7fdb077fe700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80b70 0xe92a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 msgr2=0xe93490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xe93490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80b70 msgr2=0xe92a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80b70 0xe92a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb06ffd700 1 -- 172.21.15.94:0/2110047174 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc0041f0 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb077fe700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80b70 0xe92a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xe92f50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdafc003cf0 tx=0x7fdafc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fead3dc744b4c98a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 1 -- 172.21.15.94:0/2110047174 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc01e840 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc1b1e0 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 1 -- 172.21.15.94:0/2110047174 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdafc029af0 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 1 -- 172.21.15.94:0/2110047174 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdafc006b30 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 10 client.4683 fetch_fsmap learned FSMap version 6 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xdac770 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 1 -- 172.21.15.94:0/2110047174 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc1b1e0 con 0xe80f50 2024-03-18T18:09:29.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 1 -- 172.21.15.94:0/2110047174 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) v1 ==== 2024+0+0 (secure 0 0 0) 0x7fdafc029cb0 con 0xe80f50 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 10 client.4683 fetch_fsmap finished waiting for FSMap version 6 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 10 client.4683 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 20 client.4683 populate_metadata read hostname 'smithi094' 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xec0a30 0xec2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 4 client.4683 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 --> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc65460 con 0xec0a30 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb077fe700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xec0a30 0xec2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdae67fc700 10 client.4683 ms_handle_connect on v2:172.21.15.151:6832/1854308487 2024-03-18T18:09:29.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.199+0000 7fdb077fe700 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xec0a30 0xec2e20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5d27573c108e36 server_cookie=c67847b36b78f075 in_seq=0 out_seq=0 2024-03-18T18:09:29.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdae67fc700 1 -- 172.21.15.94:0/2110047174 <== mds.0 v2:172.21.15.151:6832/1854308487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0xc65460 con 0xec0a30 2024-03-18T18:09:29.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdae67fc700 10 client.4683 handle_command_reply: tid=0 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 client.4683 shutdown 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 msgr2=0xe92f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xe92f50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdafc003cf0 tx=0x7fdafc0047e0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 shutdown_connections 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xec0a30 0xec2e20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xe93490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80f50 0xe92f50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 --2- 172.21.15.94:0/2110047174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80b70 0xe92a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 >> 172.21.15.94:0/2110047174 conn(0xc0e4d0 msgr2=0xe802e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdae67fc700 0 client.4683 ms_handle_reset on v2:172.21.15.151:6832/1854308487 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 shutdown_connections 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 1 -- 172.21.15.94:0/2110047174 wait complete. 2024-03-18T18:09:29.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.203+0000 7fdb1148f740 20 client.4683 trim_cache size 0 max 16384 2024-03-18T18:09:29.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.219+0000 7fdb1148f740 1 Processor -- start 2024-03-18T18:09:29.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.219+0000 7fdb1148f740 1 -- start start 2024-03-18T18:09:29.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xec7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80f50 0xea4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xea4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0xd8cb00 con 0xe80b70 2024-03-18T18:09:29.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0xda6b10 con 0xe80f50 2024-03-18T18:09:29.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0xd8cea0 con 0xea4690 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xec7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xec7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32896/0 (socket says 172.21.15.94:32896) 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 -- 172.21.15.94:0/3671823764 learned_addr learned my addr 172.21.15.94:0/3671823764 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80f50 0xea4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb07fff700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xea4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 -- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 msgr2=0xea4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xea4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 -- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80f50 msgr2=0xea4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80f50 0xea4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 -- 172.21.15.94:0/3671823764 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd929a0 con 0xe80b70 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb07fff700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xea4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80f50 0xea4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:29.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb077fe700 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xec7170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80119c0 tx=0x7fdaf8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4370e40c43f146 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdaedffb700 1 -- 172.21.15.94:0/3671823764 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8029070 con 0xe80b70 2024-03-18T18:09:29.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdaedffb700 1 -- 172.21.15.94:0/3671823764 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8011e40 con 0xe80b70 2024-03-18T18:09:29.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdaedffb700 1 -- 172.21.15.94:0/3671823764 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf801c040 con 0xe80b70 2024-03-18T18:09:29.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- 172.21.15.94:0/3671823764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 msgr2=0xec7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xec7170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80119c0 tx=0x7fdaf8018000 comp rx=0 tx=0).stop 2024-03-18T18:09:29.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- 172.21.15.94:0/3671823764 shutdown_connections 2024-03-18T18:09:29.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xea4690 0xea4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xe80f50 0xea4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 --2- 172.21.15.94:0/3671823764 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xec7170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- 172.21.15.94:0/3671823764 >> 172.21.15.94:0/3671823764 conn(0xc0e4d0 msgr2=0xec6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- 172.21.15.94:0/3671823764 shutdown_connections 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- 172.21.15.94:0/3671823764 wait complete. 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 -- start start 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.223+0000 7fdb1148f740 1 Processor -- start 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xf0a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80f50 0xf0a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xf0ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0xd9a360 con 0xe80b70 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0xe146d0 con 0xea4690 2024-03-18T18:09:29.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0xddf7d0 con 0xe80f50 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xf0a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 10 client.0 _ll_register_callbacks cb 0xd8c1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xf0a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32908/0 (socket says 172.21.15.94:32908) 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 -- 172.21.15.94:0/1325912150 learned_addr learned my addr 172.21.15.94:0/1325912150 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb07fff700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xf0ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80f50 0xf0a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 -- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80f50 msgr2=0xf0a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80f50 0xf0a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 -- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 msgr2=0xf0ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xf0ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 -- 172.21.15.94:0/1325912150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf80042d0 con 0xe80b70 2024-03-18T18:09:29.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80f50 0xf0a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:09:29.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 10 client.0 ms_handle_connect on v2:172.21.15.94:3300/0 2024-03-18T18:09:29.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb077fe700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xf0a0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdaf802d040 tx=0x7fdaf80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5309a2306ec90f4b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:09:29.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 1 -- 172.21.15.94:0/1325912150 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8018040 con 0xe80b70 2024-03-18T18:09:29.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 1 -- 172.21.15.94:0/1325912150 <== mon.0 v2:172.21.15.94:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaf8003eb0 con 0xe80b70 2024-03-18T18:09:29.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdafc009910 con 0xe80b70 2024-03-18T18:09:29.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 1 -- 172.21.15.94:0/1325912150 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaf802a460 con 0xe80b70 2024-03-18T18:09:29.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 10 client.4689 fetch_fsmap learned FSMap version 6 2024-03-18T18:09:29.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0xd86c70 con 0xe80b70 2024-03-18T18:09:29.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 1 -- 172.21.15.94:0/1325912150 <== mon.0 v2:172.21.15.94:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc009910 con 0xe80b70 2024-03-18T18:09:29.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 1 -- 172.21.15.94:0/1325912150 <== mon.0 v2:172.21.15.94:3300/0 5 ==== fsmap(e 6) v1 ==== 2024+0+0 (secure 0 0 0) 0x7fdaf8014440 con 0xe80b70 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 10 client.4689 fetch_fsmap finished waiting for FSMap version 6 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 20 client.4689 populate_metadata read hostname 'smithi094' 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xf11840 0xf0d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 4 client.4689 mds_command: new command op to 4291 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 --> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] -- command(tid 0: {"prefix": "status"}) v1 -- 0xc8a1e0 con 0xf11840 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xf11840 0xf0d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb06ffd700 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xf11840 0xf0d5e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=945980b22ebceed0 server_cookie=d6ff4321c5273ada in_seq=0 out_seq=0 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 10 client.4689 ms_handle_connect on v2:172.21.15.151:6832/1854308487 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 1 -- 172.21.15.94:0/1325912150 <== mds.0 v2:172.21.15.151:6832/1854308487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xc8a1e0 con 0xf11840 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdae67fc700 10 client.4689 handle_command_reply: tid=0 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 client.4689 shutdown 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 msgr2=0xf0a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.227+0000 7fdb1148f740 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xf0a0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdaf802d040 tx=0x7fdaf80047e0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 shutdown_connections 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0xea4690 0xf0ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:6832/1854308487,v1:172.21.15.151:6833/1854308487] conn(0xf11840 0xf0d5e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0xe80f50 0xf0a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdae67fc700 0 client.4689 ms_handle_reset on v2:172.21.15.151:6832/1854308487 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 --2- 172.21.15.94:0/1325912150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0xe80b70 0xf0a0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 >> 172.21.15.94:0/1325912150 conn(0xc0e4d0 msgr2=0xec72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 shutdown_connections 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 1 -- 172.21.15.94:0/1325912150 wait complete. 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb1148f740 20 client.4689 trim_cache size 0 max 16384 2024-03-18T18:09:29.235 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "cluster_fsid": "9be12cb7-8488-4090-a5db-a2b29f4bc5c3", 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "whoami": 0, 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4291, 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "want_state": "up:active", 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "state": "up:active", 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs", 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "rank_uptime": 16.422318757999999, 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "mdsmap_epoch": 6, 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch": 22, 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_epoch_barrier": 22, 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout: "uptime": 23.281900060000002 2024-03-18T18:09:29.236 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:09:29.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdaf4066730 msgr2=0x7fdaf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdaf4066730 0x7fdaf4068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009bf0 tx=0x7fdaf8009240 comp rx=0 tx=0).stop 2024-03-18T18:09:29.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 msgr2=0x7fdb080b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 0x7fdb080b1b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb0806abe0 tx=0x7fdb00004af0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 shutdown_connections 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fdaf4066730 0x7fdaf4068bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdb080b6c80 0x7fdb080b1b10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb0809d630 0x7fdb080b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 --2- 172.21.15.94:0/4203173619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb0806a3c0 0x7fdb08145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 >> 172.21.15.94:0/4203173619 conn(0x7fdb080bbda0 msgr2=0x7fdb0809cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 shutdown_connections 2024-03-18T18:09:29.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:09:29.231+0000 7fdb0cfa3700 1 -- 172.21.15.94:0/4203173619 wait complete. 2024-03-18T18:09:29.250 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-18T18:09:29.261 INFO:teuthology.run_tasks:Running task workunit... 2024-03-18T18:09:29.283 INFO:tasks.workunit:Pulling workunits from ref 49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T18:09:29.283 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-18T18:09:29.283 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-18T18:09:29.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:09:29.291 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-18T18:09:29.291 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-18T18:09:29.298 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-18T18:09:29.298 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-18T18:09:29.305 INFO:tasks.workunit:timeout=3h 2024-03-18T18:09:29.305 INFO:tasks.workunit:cleanup=True 2024-03-18T18:09:29.305 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 49bdc51142759622a281d3e5327eebd07cbb8bb3 2024-03-18T18:09:29.355 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-18T18:09:41.264 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:09:41.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:10:11.319 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:10:11.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:10:41.366 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:10:41.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '49bdc51142759622a281d3e5327eebd07cbb8bb3'. 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.580 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-03-18T18:10:55.581 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 49bdc511427 Merge branch 'wip-63770-reef' of https://github.com/idryomov/ceph into wip-yuri10-testing-2024-03-15-1653-reef 2024-03-18T18:10:55.584 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-18T18:10:55.617 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-18T18:10:55.620 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-18T18:10:55.620 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-18T18:10:56.455 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-18T18:10:56.561 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-18T18:10:56.625 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-18T18:10:56.628 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-18T18:10:56.628 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-18T18:10:56.684 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-18T18:10:56.689 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-18T18:10:56.689 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-18T18:10:56.740 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2024-03-18T18:10:56.741 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2024-03-18T18:10:56.742 DEBUG:teuthology.orchestra.run.smithi094:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49bdc51142759622a281d3e5327eebd07cbb8bb3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2024-03-18T18:10:56.813 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 133 tests from 4 test suites. 2024-03-18T18:10:56.813 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-03-18T18:10:56.813 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 124 tests from LibCephFS 2024-03-18T18:10:56.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2024-03-18T18:10:56.926 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenEmptyComponent (113 ms) 2024-03-18T18:10:56.926 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2024-03-18T18:11:00.967 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenReadTruncate (4041 ms) 2024-03-18T18:11:00.967 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenReadWrite 2024-03-18T18:11:01.019 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenReadWrite (52 ms) 2024-03-18T18:11:01.019 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MountNonExist 2024-03-18T18:11:01.052 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MountNonExist (33 ms) 2024-03-18T18:11:01.052 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MountDouble 2024-03-18T18:11:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MountDouble (33 ms) 2024-03-18T18:11:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MountRemount 2024-03-18T18:11:03.135 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MountRemount (2050 ms) 2024-03-18T18:11:03.136 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2024-03-18T18:11:03.150 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UnmountUnmounted (15 ms) 2024-03-18T18:11:03.150 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2024-03-18T18:11:03.159 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReleaseUnmounted (9 ms) 2024-03-18T18:11:03.159 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReleaseMounted 2024-03-18T18:11:04.185 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReleaseMounted (1026 ms) 2024-03-18T18:11:04.186 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UnmountRelease 2024-03-18T18:11:04.224 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UnmountRelease (39 ms) 2024-03-18T18:11:04.224 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Mount 2024-03-18T18:11:04.289 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Mount (65 ms) 2024-03-18T18:11:04.289 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenLayout 2024-03-18T18:11:04.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenLayout (93 ms) 2024-03-18T18:11:04.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirLs 2024-03-18T18:11:11.454 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:11:11.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:11:28.799 INFO:tasks.workunit.client.0.smithi094.stdout:rand: 3418 2024-03-18T18:11:28.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirLs (24416 ms) 2024-03-18T18:11:28.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2024-03-18T18:11:29.783 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ManyNestedDirs (985 ms) 2024-03-18T18:11:29.784 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Xattrs 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_a 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_b 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_c 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_d 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_e 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_f 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_g 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_h 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_i 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_j 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_k 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_l 2024-03-18T18:11:29.884 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_m 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_n 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_o 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_p 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_q 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_r 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_s 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_t 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_u 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_v 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_w 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_x 2024-03-18T18:11:29.885 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_y 2024-03-18T18:11:29.886 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_z 2024-03-18T18:11:29.942 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Xattrs (159 ms) 2024-03-18T18:11:29.942 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Xattrs_ll 2024-03-18T18:11:29.987 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Xattrs_ll (44 ms) 2024-03-18T18:11:29.987 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LstatSlashdot 2024-03-18T18:11:30.022 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LstatSlashdot (36 ms) 2024-03-18T18:11:30.022 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.StatDirNlink 2024-03-18T18:11:30.105 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.StatDirNlink (83 ms) 2024-03-18T18:11:30.105 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DoubleChmod 2024-03-18T18:11:30.151 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DoubleChmod (46 ms) 2024-03-18T18:11:30.151 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Fchmod 2024-03-18T18:11:30.198 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Fchmod (47 ms) 2024-03-18T18:11:30.198 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Lchmod 2024-03-18T18:11:30.263 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Lchmod (65 ms) 2024-03-18T18:11:30.263 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Fchown 2024-03-18T18:11:30.311 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Fchown (48 ms) 2024-03-18T18:11:30.311 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FlagO_PATH 2024-03-18T18:11:30.357 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FlagO_PATH (46 ms) 2024-03-18T18:11:30.357 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Symlinks 2024-03-18T18:11:30.465 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Symlinks (108 ms) 2024-03-18T18:11:30.465 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirSyms 2024-03-18T18:11:30.530 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirSyms (65 ms) 2024-03-18T18:11:30.531 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LoopSyms 2024-03-18T18:11:30.589 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LoopSyms (59 ms) 2024-03-18T18:11:30.589 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2024-03-18T18:11:30.720 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (131 ms) 2024-03-18T18:11:30.721 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.BadArgument 2024-03-18T18:11:30.774 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.BadArgument (54 ms) 2024-03-18T18:11:30.774 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.BadFileDesc 2024-03-18T18:11:30.808 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.BadFileDesc (34 ms) 2024-03-18T18:11:30.808 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2024-03-18T18:11:30.857 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReadEmptyFile (49 ms) 2024-03-18T18:11:30.857 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.PreadvPwritev 2024-03-18T18:11:30.908 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.PreadvPwritev (51 ms) 2024-03-18T18:11:30.908 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2024-03-18T18:11:30.962 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LlreadvLlwritev (54 ms) 2024-03-18T18:11:30.962 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.StripeUnitGran 2024-03-18T18:11:31.994 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.StripeUnitGran (1032 ms) 2024-03-18T18:11:31.995 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Rename 2024-03-18T18:11:32.061 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Rename (67 ms) 2024-03-18T18:11:32.061 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UseUnmounted 2024-03-18T18:11:32.075 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UseUnmounted (14 ms) 2024-03-18T18:11:32.075 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetPoolId 2024-03-18T18:11:32.104 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetPoolId (29 ms) 2024-03-18T18:11:32.104 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetPoolReplication 2024-03-18T18:11:33.133 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetPoolReplication (1029 ms) 2024-03-18T18:11:33.134 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetExtentOsds 2024-03-18T18:11:33.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetExtentOsds (44 ms) 2024-03-18T18:11:33.177 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2024-03-18T18:11:33.218 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (41 ms) 2024-03-18T18:11:33.218 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetOsdAddr 2024-03-18T18:11:33.252 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetOsdAddr (34 ms) 2024-03-18T18:11:33.252 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenNoClose 2024-03-18T18:11:33.336 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenNoClose (83 ms) 2024-03-18T18:11:33.336 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Nlink 2024-03-18T18:11:33.413 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Nlink (75 ms) 2024-03-18T18:11:33.413 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SlashDotDot 2024-03-18T18:11:35.461 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SlashDotDot (2051 ms) 2024-03-18T18:11:35.462 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Btime 2024-03-18T18:11:36.513 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Btime (1052 ms) 2024-03-18T18:11:36.513 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetBtime 2024-03-18T18:11:36.565 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetBtime (52 ms) 2024-03-18T18:11:36.565 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LazyStatx 2024-03-18T18:11:37.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LazyStatx (1086 ms) 2024-03-18T18:11:37.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ChangeAttr 2024-03-18T18:11:37.712 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ChangeAttr (61 ms) 2024-03-18T18:11:37.712 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2024-03-18T18:11:37.813 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (101 ms) 2024-03-18T18:11:37.814 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2024-03-18T18:11:37.915 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (102 ms) 2024-03-18T18:11:37.915 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2024-03-18T18:11:37.993 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (74 ms) 2024-03-18T18:11:37.993 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetSize 2024-03-18T18:11:38.024 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetSize (35 ms) 2024-03-18T18:11:38.024 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2024-03-18T18:11:38.060 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OperationsOnRoot (36 ms) 2024-03-18T18:11:38.060 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ShutdownRace 2024-03-18T18:11:38.060 INFO:tasks.workunit.client.0.smithi094.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2024-03-18T18:11:41.892 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:11:41.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:12:07.696 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ShutdownRace (29636 ms) 2024-03-18T18:12:07.696 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.TestUtime 2024-03-18T18:12:07.751 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.TestUtime (56 ms) 2024-03-18T18:12:07.752 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.TestUtimes 2024-03-18T18:12:07.817 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.TestUtimes (65 ms) 2024-03-18T18:12:07.817 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.TestFutimens 2024-03-18T18:12:07.873 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.TestFutimens (56 ms) 2024-03-18T18:12:07.873 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2024-03-18T18:12:07.936 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OperationsOnDotDot (63 ms) 2024-03-18T18:12:07.936 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Caps_vxattr 2024-03-18T18:12:07.981 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Caps_vxattr (45 ms) 2024-03-18T18:12:07.981 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapXattrs 2024-03-18T18:12:09.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapXattrs (1031 ms) 2024-03-18T18:12:09.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Lseek 2024-03-18T18:12:09.065 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Lseek (54 ms) 2024-03-18T18:12:09.066 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2024-03-18T18:12:10.097 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1031 ms) 2024-03-18T18:12:10.098 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2024-03-18T18:12:11.130 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.EmptySnapInfo (1033 ms) 2024-03-18T18:12:11.130 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapInfo 2024-03-18T18:12:11.941 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:12:11.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:12:12.160 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapInfo (1030 ms) 2024-03-18T18:12:12.160 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2024-03-18T18:12:12.197 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LookupInoMDSDir (37 ms) 2024-03-18T18:12:12.197 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LookupVino 2024-03-18T18:12:14.297 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LookupVino (2099 ms) 2024-03-18T18:12:14.298 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Openat 2024-03-18T18:12:14.409 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Openat (114 ms) 2024-03-18T18:12:14.410 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Statxat 2024-03-18T18:12:14.506 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Statxat (97 ms) 2024-03-18T18:12:14.507 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2024-03-18T18:12:14.611 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.StatxatATFDCWD (104 ms) 2024-03-18T18:12:14.611 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Fdopendir 2024-03-18T18:12:14.725 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Fdopendir (114 ms) 2024-03-18T18:12:14.725 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2024-03-18T18:12:14.820 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (92 ms) 2024-03-18T18:12:14.820 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2024-03-18T18:12:14.897 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (80 ms) 2024-03-18T18:12:14.897 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2024-03-18T18:12:14.991 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (94 ms) 2024-03-18T18:12:14.991 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Mkdirat 2024-03-18T18:12:15.041 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Mkdirat (51 ms) 2024-03-18T18:12:15.042 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2024-03-18T18:12:15.112 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (71 ms) 2024-03-18T18:12:15.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Readlinkat 2024-03-18T18:12:15.226 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Readlinkat (113 ms) 2024-03-18T18:12:15.226 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2024-03-18T18:12:15.322 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (94 ms) 2024-03-18T18:12:15.322 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Symlinkat 2024-03-18T18:12:15.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Symlinkat (95 ms) 2024-03-18T18:12:15.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2024-03-18T18:12:15.504 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (89 ms) 2024-03-18T18:12:15.504 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Unlinkat 2024-03-18T18:12:15.597 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Unlinkat (93 ms) 2024-03-18T18:12:15.597 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2024-03-18T18:12:15.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (92 ms) 2024-03-18T18:12:15.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Chownat 2024-03-18T18:12:15.789 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Chownat (100 ms) 2024-03-18T18:12:15.789 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2024-03-18T18:12:15.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ChownatATFDCWD (78 ms) 2024-03-18T18:12:15.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Chmodat 2024-03-18T18:12:15.962 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Chmodat (95 ms) 2024-03-18T18:12:15.962 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2024-03-18T18:12:16.075 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (113 ms) 2024-03-18T18:12:16.075 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Utimensat 2024-03-18T18:12:20.995 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Utimensat (4918 ms) 2024-03-18T18:12:20.996 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2024-03-18T18:12:26.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (5021 ms) 2024-03-18T18:12:26.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2024-03-18T18:12:26.589 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (575 ms) 2024-03-18T18:12:26.590 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2024-03-18T18:12:27.624 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (1035 ms) 2024-03-18T18:12:27.625 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetMountTimeout 2024-03-18T18:12:28.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetMountTimeout (1026 ms) 2024-03-18T18:12:28.651 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FsCrypt 2024-03-18T18:12:29.720 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FsCrypt (1069 ms) 2024-03-18T18:12:29.720 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2024-03-18T18:12:30.753 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrs (1033 ms) 2024-03-18T18:12:30.753 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2024-03-18T18:12:31.792 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1040 ms) 2024-03-18T18:12:31.792 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2024-03-18T18:12:32.823 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1030 ms) 2024-03-18T18:12:32.823 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2024-03-18T18:12:33.858 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1036 ms) 2024-03-18T18:12:33.858 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReaddirRCB 2024-03-18T18:12:34.937 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReaddirRCB (1079 ms) 2024-03-18T18:12:34.937 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MulticlientSimple 2024-03-18T18:12:35.105 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MulticlientSimple (167 ms) 2024-03-18T18:12:35.105 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2024-03-18T18:12:35.216 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (111 ms) 2024-03-18T18:12:35.216 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2024-03-18T18:12:42.002 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:12:42.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:12.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:12.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:35.280 INFO:tasks.workunit.client.0.smithi094.stdout: Will run test for 60 seconds! 2024-03-18T18:13:35.280 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60065 ms) 2024-03-18T18:13:35.280 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.BasicLocking 2024-03-18T18:13:35.352 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.BasicLocking (72 ms) 2024-03-18T18:13:35.352 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2024-03-18T18:13:35.448 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ConcurrentLocking (97 ms) 2024-03-18T18:13:35.448 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2024-03-18T18:13:35.564 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ThreesomeLocking (115 ms) 2024-03-18T18:13:35.564 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2024-03-18T18:13:35.624 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.BasicRecordLocking (60 ms) 2024-03-18T18:13:35.624 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2024-03-18T18:13:35.710 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (86 ms) 2024-03-18T18:13:35.710 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2024-03-18T18:13:35.811 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (102 ms) 2024-03-18T18:13:35.812 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DelegMultiClient 2024-03-18T18:13:37.328 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DelegMultiClient (1515 ms) 2024-03-18T18:13:37.328 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DelegSingleClient 2024-03-18T18:13:37.536 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DelegSingleClient (210 ms) 2024-03-18T18:13:37.537 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DelegTimeout 2024-03-18T18:13:39.621 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DelegTimeout (2084 ms) 2024-03-18T18:13:39.621 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.RecalledGetattr 2024-03-18T18:13:39.749 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.RecalledGetattr (128 ms) 2024-03-18T18:13:39.749 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2024-03-18T18:13:39.793 INFO:tasks.workunit.client.0.smithi094.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@default"} 2024-03-18T18:13:39.825 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (77 ms) 2024-03-18T18:13:39.826 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2024-03-18T18:13:39.874 INFO:tasks.workunit.client.0.smithi094.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@set"} 2024-03-18T18:13:39.875 INFO:tasks.workunit.client.0.smithi094.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@inherited"} 2024-03-18T18:13:39.902 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (77 ms) 2024-03-18T18:13:39.902 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2024-03-18T18:13:39.981 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (78 ms) 2024-03-18T18:13:39.981 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2024-03-18T18:13:40.051 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (70 ms) 2024-03-18T18:13:40.052 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2024-03-18T18:13:40.125 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (74 ms) 2024-03-18T18:13:40.125 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2024-03-18T18:13:40.200 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (74 ms) 2024-03-18T18:13:40.200 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2024-03-18T18:13:40.274 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetAndSetDirPin (74 ms) 2024-03-18T18:13:40.274 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2024-03-18T18:13:40.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (68 ms) 2024-03-18T18:13:40.342 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2024-03-18T18:13:40.415 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (74 ms) 2024-03-18T18:13:40.416 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapDiffLib 2024-03-18T18:13:40.593 INFO:tasks.workunit.client.0.smithi094.stdout:16 vs. 17 2024-03-18T18:13:40.594 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:40.978 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:42.264 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:42.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:45.977 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing for / 2024-03-18T18:13:45.987 INFO:tasks.workunit.client.0.smithi094.stdout:dirB snap 17 2024-03-18T18:13:45.987 INFO:tasks.workunit.client.0.smithi094.stdout:fileB snap 17 2024-03-18T18:13:45.987 INFO:tasks.workunit.client.0.smithi094.stdout:fileC snap 16 2024-03-18T18:13:45.987 INFO:tasks.workunit.client.0.smithi094.stdout:fileA snap 17 2024-03-18T18:13:45.988 INFO:tasks.workunit.client.0.smithi094.stdout:dirC snap 16 2024-03-18T18:13:45.989 INFO:tasks.workunit.client.0.smithi094.stdout:dirD snap 17 2024-03-18T18:13:45.990 INFO:tasks.workunit.client.0.smithi094.stdout:dirA snap 17 2024-03-18T18:13:45.990 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-03-18T18:13:46.003 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2024-03-18T18:13:46.014 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2024-03-18T18:13:46.028 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap1 diff listing verification for /dirC 2024-03-18T18:13:46.040 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2024-03-18T18:13:46.049 INFO:tasks.workunit.client.0.smithi094.stdout:---------invalid snapdiff params, the same snaps--------- 2024-03-18T18:13:46.053 INFO:tasks.workunit.client.0.smithi094.stdout:---------invalid snapdiff params, no snap_other --------- 2024-03-18T18:13:46.053 INFO:tasks.workunit.client.0.smithi094.stdout:------------- closing ------------- 2024-03-18T18:13:46.053 INFO:tasks.workunit.client.0.smithi094.stderr: Failed to readdir snapdiff, ret:-22 , snap2 vs. snap2 2024-03-18T18:13:46.054 INFO:tasks.workunit.client.0.smithi094.stderr: Failed to open snapdiff, ret:-22 2024-03-18T18:13:46.495 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapDiffLib (6080 ms) 2024-03-18T18:13:46.496 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapDiffLib2 2024-03-18T18:13:46.762 INFO:tasks.workunit.client.0.smithi094.stdout:20 vs. 21 vs. 22 2024-03-18T18:13:46.762 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:50.977 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:55.977 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 listing verification--------- 2024-03-18T18:13:55.989 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:56.000 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:56.010 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 listing verification--------- 2024-03-18T18:13:56.017 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing for / 2024-03-18T18:13:56.026 INFO:tasks.workunit.client.0.smithi094.stdout:fileG snap 21 2024-03-18T18:13:56.027 INFO:tasks.workunit.client.0.smithi094.stdout:dirB snap 21 2024-03-18T18:13:56.027 INFO:tasks.workunit.client.0.smithi094.stdout:fileB snap 21 2024-03-18T18:13:56.027 INFO:tasks.workunit.client.0.smithi094.stdout:fileC snap 20 2024-03-18T18:13:56.028 INFO:tasks.workunit.client.0.smithi094.stdout:fileA snap 21 2024-03-18T18:13:56.028 INFO:tasks.workunit.client.0.smithi094.stdout:dirC snap 20 2024-03-18T18:13:56.029 INFO:tasks.workunit.client.0.smithi094.stdout:dirD snap 21 2024-03-18T18:13:56.029 INFO:tasks.workunit.client.0.smithi094.stdout:fileF snap 20 2024-03-18T18:13:56.030 INFO:tasks.workunit.client.0.smithi094.stdout:dirA snap 21 2024-03-18T18:13:56.030 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-03-18T18:13:56.044 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:56.054 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:56.063 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 listing verification--------- 2024-03-18T18:13:56.069 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap1 diff listing verification for / 2024-03-18T18:13:56.081 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:56.091 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:56.100 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 listing verification--------- 2024-03-18T18:13:56.107 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for / 2024-03-18T18:13:56.117 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for / 2024-03-18T18:13:56.127 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:56.134 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:56.141 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 listing verification--------- 2024-03-18T18:13:56.147 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing for /dirA 2024-03-18T18:13:56.153 INFO:tasks.workunit.client.0.smithi094.stdout:fileA snap 21 2024-03-18T18:13:56.153 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2024-03-18T18:13:56.159 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing for /dirB 2024-03-18T18:13:56.168 INFO:tasks.workunit.client.0.smithi094.stdout:fileb snap 21 2024-03-18T18:13:56.168 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2024-03-18T18:13:56.177 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing for /dirD 2024-03-18T18:13:56.185 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2024-03-18T18:13:56.195 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 listing verification--------- 2024-03-18T18:13:56.206 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 listing verification--------- 2024-03-18T18:13:56.216 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 listing verification--------- 2024-03-18T18:13:56.224 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-03-18T18:13:56.238 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap2 diff listing verification for / 2024-03-18T18:13:56.251 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for / 2024-03-18T18:13:56.265 INFO:tasks.workunit.client.0.smithi094.stdout:------------- closing ------------- 2024-03-18T18:13:56.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapDiffLib2 (10090 ms) 2024-03-18T18:13:56.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapDiffCases1_2 2024-03-18T18:13:57.248 INFO:tasks.workunit.client.0.smithi094.stdout:26 vs. 27 2024-03-18T18:13:57.249 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing for / 2024-03-18T18:13:57.259 INFO:tasks.workunit.client.0.smithi094.stdout:C snap 26 2024-03-18T18:13:57.261 INFO:tasks.workunit.client.0.smithi094.stdout:L snap 27 2024-03-18T18:13:57.262 INFO:tasks.workunit.client.0.smithi094.stdout:S snap 27 2024-03-18T18:13:57.262 INFO:tasks.workunit.client.0.smithi094.stdout:T snap 27 2024-03-18T18:13:57.263 INFO:tasks.workunit.client.0.smithi094.stdout:d snap 27 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:G snap 26 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:l snap 27 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:e snap 27 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:~e snap 27 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:g snap 26 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:c snap 26 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:b snap 27 2024-03-18T18:13:57.264 INFO:tasks.workunit.client.0.smithi094.stdout:f snap 27 2024-03-18T18:13:57.265 INFO:tasks.workunit.client.0.smithi094.stdout:I snap 27 2024-03-18T18:13:57.266 INFO:tasks.workunit.client.0.smithi094.stdout:K snap 27 2024-03-18T18:13:57.267 INFO:tasks.workunit.client.0.smithi094.stdout:k snap 27 2024-03-18T18:13:57.267 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-03-18T18:13:57.283 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /S 2024-03-18T18:13:57.289 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /T 2024-03-18T18:13:57.296 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap1 diff listing verification for /C 2024-03-18T18:13:57.306 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap1 diff listing verification for /C/CC 2024-03-18T18:13:57.317 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /I 2024-03-18T18:13:57.327 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /I/J 2024-03-18T18:13:57.339 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /L 2024-03-18T18:13:57.353 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /L/LL 2024-03-18T18:13:57.365 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /L/LN 2024-03-18T18:13:57.378 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for /L/LM 2024-03-18T18:13:57.390 INFO:tasks.workunit.client.0.smithi094.stdout:------------- 2024-03-18T18:13:57.664 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapDiffCases1_2 (1078 ms) 2024-03-18T18:13:57.664 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapDiffCases2_3 2024-03-18T18:13:58.332 INFO:tasks.workunit.client.0.smithi094.stdout:33 vs. 34 2024-03-18T18:13:58.333 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing for / 2024-03-18T18:13:58.341 INFO:tasks.workunit.client.0.smithi094.stdout:H snap 34 2024-03-18T18:13:58.342 INFO:tasks.workunit.client.0.smithi094.stdout:L snap 34 2024-03-18T18:13:58.343 INFO:tasks.workunit.client.0.smithi094.stdout:S snap 34 2024-03-18T18:13:58.343 INFO:tasks.workunit.client.0.smithi094.stdout:ff snap 33 2024-03-18T18:13:58.344 INFO:tasks.workunit.client.0.smithi094.stdout:T snap 34 2024-03-18T18:13:58.344 INFO:tasks.workunit.client.0.smithi094.stdout:d snap 34 2024-03-18T18:13:58.345 INFO:tasks.workunit.client.0.smithi094.stdout:G snap 34 2024-03-18T18:13:58.345 INFO:tasks.workunit.client.0.smithi094.stdout:e snap 33 2024-03-18T18:13:58.345 INFO:tasks.workunit.client.0.smithi094.stdout:~e snap 33 2024-03-18T18:13:58.345 INFO:tasks.workunit.client.0.smithi094.stdout:g snap 34 2024-03-18T18:13:58.346 INFO:tasks.workunit.client.0.smithi094.stdout:b snap 34 2024-03-18T18:13:58.346 INFO:tasks.workunit.client.0.smithi094.stdout:f snap 33 2024-03-18T18:13:58.346 INFO:tasks.workunit.client.0.smithi094.stdout:I snap 34 2024-03-18T18:13:58.346 INFO:tasks.workunit.client.0.smithi094.stdout:a snap 34 2024-03-18T18:13:58.346 INFO:tasks.workunit.client.0.smithi094.stdout:K snap 33 2024-03-18T18:13:58.346 INFO:tasks.workunit.client.0.smithi094.stdout:k snap 33 2024-03-18T18:13:58.347 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for / 2024-03-18T18:13:58.362 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /S 2024-03-18T18:13:58.374 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /T 2024-03-18T18:13:58.385 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /G 2024-03-18T18:13:58.397 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap2 diff listing verification for /K 2024-03-18T18:13:58.411 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /H 2024-03-18T18:13:58.422 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /I 2024-03-18T18:13:58.433 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /I/J 2024-03-18T18:13:58.444 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /L 2024-03-18T18:13:58.457 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /L/LL 2024-03-18T18:13:58.468 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap2 diff listing verification for /L/LM 2024-03-18T18:13:58.482 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap2 vs. snap3 diff listing verification for /L/LN 2024-03-18T18:13:59.752 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapDiffCases2_3 (2087 ms) 2024-03-18T18:13:59.752 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapDiffCases1_3 2024-03-18T18:14:00.450 INFO:tasks.workunit.client.0.smithi094.stdout:38 vs. 40 2024-03-18T18:14:00.450 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing for / 2024-03-18T18:14:00.461 INFO:tasks.workunit.client.0.smithi094.stdout:C snap 38 2024-03-18T18:14:00.463 INFO:tasks.workunit.client.0.smithi094.stdout:H snap 40 2024-03-18T18:14:00.463 INFO:tasks.workunit.client.0.smithi094.stdout:L snap 40 2024-03-18T18:14:00.464 INFO:tasks.workunit.client.0.smithi094.stdout:S snap 40 2024-03-18T18:14:00.464 INFO:tasks.workunit.client.0.smithi094.stdout:ff snap 38 2024-03-18T18:14:00.465 INFO:tasks.workunit.client.0.smithi094.stdout:T snap 40 2024-03-18T18:14:00.465 INFO:tasks.workunit.client.0.smithi094.stdout:d snap 40 2024-03-18T18:14:00.465 INFO:tasks.workunit.client.0.smithi094.stdout:G snap 38 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:G snap 40 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:l snap 40 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:e snap 38 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:~e snap 38 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:g snap 40 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:c snap 38 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:b snap 40 2024-03-18T18:14:00.467 INFO:tasks.workunit.client.0.smithi094.stdout:f snap 38 2024-03-18T18:14:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:I snap 40 2024-03-18T18:14:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:a snap 40 2024-03-18T18:14:00.468 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap1 diff listing verification for / 2024-03-18T18:14:00.480 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap1 diff listing verification for /S 2024-03-18T18:14:00.490 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap1 diff listing verification for /T 2024-03-18T18:14:00.500 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap1 diff listing verification for /C 2024-03-18T18:14:00.520 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap1 diff listing verification for /C/CC 2024-03-18T18:14:00.542 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /G 2024-03-18T18:14:00.548 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap3 vs. snap1 diff listing verification for /G 2024-03-18T18:14:00.553 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /H 2024-03-18T18:14:00.561 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /I 2024-03-18T18:14:00.570 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /I/J 2024-03-18T18:14:00.582 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /L 2024-03-18T18:14:00.595 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /L/LL 2024-03-18T18:14:00.605 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap3 diff listing verification for /L/LN 2024-03-18T18:14:00.618 INFO:tasks.workunit.client.0.smithi094.stdout:------------- 2024-03-18T18:14:01.828 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapDiffCases1_3 (2077 ms) 2024-03-18T18:14:01.828 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.HugeSnapDiffSmallDelta 2024-03-18T18:14:12.318 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:14:12.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:14:42.366 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:14:42.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:15:12.422 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:15:12.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:15:33.435 INFO:tasks.workunit.client.0.smithi094.stdout:Seeding 10000 files... 2024-03-18T18:15:33.435 INFO:tasks.workunit.client.0.smithi094.stdout:44 vs. 45 2024-03-18T18:15:33.435 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-03-18T18:15:34.396 INFO:tasks.workunit.client.0.smithi094.stdout:------------- closing ------------- 2024-03-18T18:15:42.881 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:15:42.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:16:12.932 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:16:12.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:16:40.040 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.HugeSnapDiffSmallDelta (158211 ms) 2024-03-18T18:16:40.040 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.HugeSnapDiffLargeDelta 2024-03-18T18:16:42.978 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:16:42.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:17:13.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:17:13.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:17:43.515 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:17:43.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:18:13.920 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:18:13.923 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:18:44.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:18:44.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:19:14.073 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:19:14.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:19:44.113 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:19:44.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:14.158 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:14.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:44.206 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:44.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:14.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:14.256 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:44.309 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:44.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:14.188 INFO:tasks.workunit.client.0.smithi094.stdout:Seeding 15100 files... 2024-03-18T18:22:14.188 INFO:tasks.workunit.client.0.smithi094.stdout:48 vs. 49 2024-03-18T18:22:14.189 INFO:tasks.workunit.client.0.smithi094.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-03-18T18:22:14.355 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:14.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:18.095 INFO:tasks.workunit.client.0.smithi094.stdout:------------- closing ------------- 2024-03-18T18:22:44.412 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:44.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:44.552 INFO:tasks.ceph.mds.b.smithi151.stderr:2024-03-18T18:22:44.547+0000 7f1fd6be8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31716) UID: 0 2024-03-18T18:23:52.745 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.HugeSnapDiffLargeDelta (432701 ms) 2024-03-18T18:23:52.745 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 124 tests from LibCephFS (775928 ms total) 2024-03-18T18:23:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:23:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from Caps 2024-03-18T18:23:52.746 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] Caps.ReadZero 2024-03-18T18:23:53.340 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] Caps.ReadZero (599 ms) 2024-03-18T18:23:53.340 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from Caps (599 ms total) 2024-03-18T18:23:53.340 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:23:53.340 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 5 tests from ACL 2024-03-18T18:23:53.340 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ACL.SetACL 2024-03-18T18:23:53.409 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ACL.SetACL (70 ms) 2024-03-18T18:23:53.409 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ACL.Chmod 2024-03-18T18:23:53.463 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ACL.Chmod (54 ms) 2024-03-18T18:23:53.464 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ACL.DefaultACL 2024-03-18T18:23:53.588 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ACL.DefaultACL (122 ms) 2024-03-18T18:23:53.588 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ACL.Disabled 2024-03-18T18:23:53.697 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ACL.Disabled (111 ms) 2024-03-18T18:23:53.697 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ACL.SnapdirACL 2024-03-18T18:23:54.745 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ACL.SnapdirACL (1048 ms) 2024-03-18T18:23:54.745 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 5 tests from ACL (1405 ms total) 2024-03-18T18:23:54.745 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:23:54.745 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 3 tests from MonConfig 2024-03-18T18:23:54.745 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] MonConfig.MonAddrsMissing 2024-03-18T18:23:54.758 INFO:tasks.workunit.client.0.smithi094.stderr:failed to get an address for mon.a: error -2 2024-03-18T18:23:54.758 INFO:tasks.workunit.client.0.smithi094.stderr:failed to get an address for mon.b: error -2 2024-03-18T18:23:54.758 INFO:tasks.workunit.client.0.smithi094.stderr:failed to get an address for mon.c: error -2 2024-03-18T18:23:54.796 INFO:tasks.workunit.client.0.smithi094.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-03-18T18:23:54.797 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] MonConfig.MonAddrsMissing (52 ms) 2024-03-18T18:23:54.797 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2024-03-18T18:23:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (43 ms) 2024-03-18T18:23:54.840 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] MonConfig.MonAddrsInCct 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] MonConfig.MonAddrsInCct (1053 ms) 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 3 tests from MonConfig (1148 ms total) 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 133 tests from 4 test suites ran. (779080 ms total) 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 133 tests. 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout: YOU HAVE 4 DISABLED TESTS 2024-03-18T18:23:55.893 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:23:55.999 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 98 tests from 2 test suites. 2024-03-18T18:23:55.999 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-03-18T18:23:56.000 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 94 tests from LibCephFS 2024-03-18T18:23:56.000 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2024-03-18T18:23:56.253 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenEmptyComponent (246 ms) 2024-03-18T18:23:56.253 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2024-03-18T18:24:01.016 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenReadTruncate (4770 ms) 2024-03-18T18:24:01.016 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenReadWrite 2024-03-18T18:24:02.040 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenReadWrite (1025 ms) 2024-03-18T18:24:02.041 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MountNonExist 2024-03-18T18:24:02.074 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MountNonExist (33 ms) 2024-03-18T18:24:02.074 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MountDouble 2024-03-18T18:24:02.103 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MountDouble (30 ms) 2024-03-18T18:24:02.103 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MountRemount 2024-03-18T18:24:02.144 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MountRemount (40 ms) 2024-03-18T18:24:02.144 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2024-03-18T18:24:02.153 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UnmountUnmounted (9 ms) 2024-03-18T18:24:02.153 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2024-03-18T18:24:02.162 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReleaseUnmounted (10 ms) 2024-03-18T18:24:02.162 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReleaseMounted 2024-03-18T18:24:03.186 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReleaseMounted (1023 ms) 2024-03-18T18:24:03.186 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UnmountRelease 2024-03-18T18:24:04.218 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UnmountRelease (1032 ms) 2024-03-18T18:24:04.218 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Mount 2024-03-18T18:24:06.281 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Mount (2063 ms) 2024-03-18T18:24:06.281 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenLayout 2024-03-18T18:24:06.442 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenLayout (161 ms) 2024-03-18T18:24:06.442 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirLs 2024-03-18T18:24:32.550 INFO:tasks.workunit.client.0.smithi094.stdout:rand: 3616 2024-03-18T18:24:32.550 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirLs (26108 ms) 2024-03-18T18:24:32.550 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2024-03-18T18:24:33.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ManyNestedDirs (1077 ms) 2024-03-18T18:24:33.626 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Xattrs 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_a 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_b 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_c 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_d 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_e 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_f 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_g 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_h 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_i 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_j 2024-03-18T18:24:33.721 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_k 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_l 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_m 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_n 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_o 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_p 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_q 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_r 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_s 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_t 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_u 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_v 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_w 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_x 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_y 2024-03-18T18:24:33.722 INFO:tasks.workunit.client.0.smithi094.stdout:getting attr user.test_xattr_z 2024-03-18T18:24:33.782 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Xattrs (156 ms) 2024-03-18T18:24:33.782 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Xattrs_ll 2024-03-18T18:24:33.827 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Xattrs_ll (45 ms) 2024-03-18T18:24:33.827 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LstatSlashdot 2024-03-18T18:24:33.865 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LstatSlashdot (38 ms) 2024-03-18T18:24:33.865 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.StatDirNlink 2024-03-18T18:24:33.975 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.StatDirNlink (110 ms) 2024-03-18T18:24:33.975 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DoubleChmod 2024-03-18T18:24:34.045 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DoubleChmod (70 ms) 2024-03-18T18:24:34.046 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Fchmod 2024-03-18T18:24:34.115 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Fchmod (69 ms) 2024-03-18T18:24:34.115 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Lchmod 2024-03-18T18:24:34.205 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Lchmod (91 ms) 2024-03-18T18:24:34.205 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Fchown 2024-03-18T18:24:34.246 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Fchown (41 ms) 2024-03-18T18:24:34.246 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FlagO_PATH 2024-03-18T18:24:34.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FlagO_PATH (49 ms) 2024-03-18T18:24:34.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Symlinks 2024-03-18T18:24:34.481 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Symlinks (186 ms) 2024-03-18T18:24:34.481 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirSyms 2024-03-18T18:24:34.648 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirSyms (161 ms) 2024-03-18T18:24:34.648 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LoopSyms 2024-03-18T18:24:34.747 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LoopSyms (105 ms) 2024-03-18T18:24:34.748 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2024-03-18T18:24:35.001 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (253 ms) 2024-03-18T18:24:35.001 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.BadArgument 2024-03-18T18:24:35.055 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.BadArgument (54 ms) 2024-03-18T18:24:35.055 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.BadFileDesc 2024-03-18T18:24:35.089 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.BadFileDesc (34 ms) 2024-03-18T18:24:35.089 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2024-03-18T18:24:35.141 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReadEmptyFile (51 ms) 2024-03-18T18:24:35.141 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.PreadvPwritev 2024-03-18T18:24:35.199 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.PreadvPwritev (58 ms) 2024-03-18T18:24:35.199 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2024-03-18T18:24:35.256 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LlreadvLlwritev (57 ms) 2024-03-18T18:24:35.256 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.StripeUnitGran 2024-03-18T18:24:36.288 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.StripeUnitGran (1032 ms) 2024-03-18T18:24:36.288 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Rename 2024-03-18T18:24:36.356 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Rename (68 ms) 2024-03-18T18:24:36.356 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UseUnmounted 2024-03-18T18:24:36.370 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UseUnmounted (14 ms) 2024-03-18T18:24:36.370 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetPoolId 2024-03-18T18:24:36.404 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetPoolId (33 ms) 2024-03-18T18:24:36.404 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetPoolReplication 2024-03-18T18:24:36.441 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetPoolReplication (38 ms) 2024-03-18T18:24:36.441 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetExtentOsds 2024-03-18T18:24:36.490 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetExtentOsds (49 ms) 2024-03-18T18:24:36.490 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2024-03-18T18:24:36.537 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (47 ms) 2024-03-18T18:24:36.537 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.GetOsdAddr 2024-03-18T18:24:37.567 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.GetOsdAddr (1030 ms) 2024-03-18T18:24:37.567 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OpenNoClose 2024-03-18T18:24:37.731 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OpenNoClose (164 ms) 2024-03-18T18:24:37.731 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Nlink 2024-03-18T18:24:37.908 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Nlink (177 ms) 2024-03-18T18:24:37.908 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SlashDotDot 2024-03-18T18:24:39.029 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SlashDotDot (1121 ms) 2024-03-18T18:24:39.030 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Btime 2024-03-18T18:24:40.084 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Btime (1055 ms) 2024-03-18T18:24:40.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetBtime 2024-03-18T18:24:40.133 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetBtime (49 ms) 2024-03-18T18:24:40.133 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LazyStatx 2024-03-18T18:24:41.224 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LazyStatx (1091 ms) 2024-03-18T18:24:41.224 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ChangeAttr 2024-03-18T18:24:41.296 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ChangeAttr (72 ms) 2024-03-18T18:24:41.297 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2024-03-18T18:24:41.528 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (227 ms) 2024-03-18T18:24:41.528 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2024-03-18T18:24:41.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (156 ms) 2024-03-18T18:24:41.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2024-03-18T18:24:41.856 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (173 ms) 2024-03-18T18:24:41.856 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetSize 2024-03-18T18:24:41.959 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetSize (107 ms) 2024-03-18T18:24:41.959 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2024-03-18T18:24:41.997 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OperationsOnRoot (38 ms) 2024-03-18T18:24:41.998 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ShutdownRace 2024-03-18T18:24:41.998 INFO:tasks.workunit.client.0.smithi094.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2024-03-18T18:25:10.755 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ShutdownRace (28758 ms) 2024-03-18T18:25:10.755 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.TestUtime 2024-03-18T18:25:10.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.TestUtime (67 ms) 2024-03-18T18:25:10.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.TestUtimes 2024-03-18T18:25:10.884 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.TestUtimes (62 ms) 2024-03-18T18:25:10.884 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.TestFutimens 2024-03-18T18:25:10.937 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.TestFutimens (54 ms) 2024-03-18T18:25:10.938 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2024-03-18T18:25:11.002 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.OperationsOnDotDot (64 ms) 2024-03-18T18:25:11.002 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Caps_vxattr 2024-03-18T18:25:11.040 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Caps_vxattr (38 ms) 2024-03-18T18:25:11.040 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapXattrs 2024-03-18T18:25:12.067 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapXattrs (1027 ms) 2024-03-18T18:25:12.067 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Lseek 2024-03-18T18:25:12.123 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Lseek (56 ms) 2024-03-18T18:25:12.123 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2024-03-18T18:25:13.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1031 ms) 2024-03-18T18:25:13.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2024-03-18T18:25:14.185 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.EmptySnapInfo (1032 ms) 2024-03-18T18:25:14.186 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapInfo 2024-03-18T18:25:15.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapInfo (1033 ms) 2024-03-18T18:25:15.219 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2024-03-18T18:25:15.254 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LookupInoMDSDir (35 ms) 2024-03-18T18:25:15.254 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LookupVino 2024-03-18T18:25:17.449 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LookupVino (2195 ms) 2024-03-18T18:25:17.449 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Openat 2024-03-18T18:25:17.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Openat (134 ms) 2024-03-18T18:25:17.585 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Statxat 2024-03-18T18:25:17.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Statxat (207 ms) 2024-03-18T18:25:17.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2024-03-18T18:25:17.914 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.StatxatATFDCWD (124 ms) 2024-03-18T18:25:17.914 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Fdopendir 2024-03-18T18:25:18.159 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Fdopendir (245 ms) 2024-03-18T18:25:18.160 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2024-03-18T18:25:18.368 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (209 ms) 2024-03-18T18:25:18.368 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2024-03-18T18:25:18.515 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (147 ms) 2024-03-18T18:25:18.516 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2024-03-18T18:25:18.731 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (216 ms) 2024-03-18T18:25:18.731 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Mkdirat 2024-03-18T18:25:18.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Mkdirat (91 ms) 2024-03-18T18:25:18.823 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2024-03-18T18:25:18.878 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (56 ms) 2024-03-18T18:25:18.878 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Readlinkat 2024-03-18T18:25:19.094 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Readlinkat (217 ms) 2024-03-18T18:25:19.095 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2024-03-18T18:25:19.244 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (145 ms) 2024-03-18T18:25:19.244 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Symlinkat 2024-03-18T18:25:19.409 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Symlinkat (168 ms) 2024-03-18T18:25:19.409 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2024-03-18T18:25:19.547 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (138 ms) 2024-03-18T18:25:19.547 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Unlinkat 2024-03-18T18:25:19.718 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Unlinkat (171 ms) 2024-03-18T18:25:19.718 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2024-03-18T18:25:19.908 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (187 ms) 2024-03-18T18:25:19.908 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Chownat 2024-03-18T18:25:20.088 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Chownat (178 ms) 2024-03-18T18:25:20.088 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2024-03-18T18:25:20.225 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ChownatATFDCWD (142 ms) 2024-03-18T18:25:20.225 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Chmodat 2024-03-18T18:25:20.380 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Chmodat (155 ms) 2024-03-18T18:25:20.380 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2024-03-18T18:25:20.576 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (189 ms) 2024-03-18T18:25:20.576 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.Utimensat 2024-03-18T18:25:20.795 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.Utimensat (226 ms) 2024-03-18T18:25:20.795 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2024-03-18T18:25:20.993 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (198 ms) 2024-03-18T18:25:20.993 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2024-03-18T18:25:21.619 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (626 ms) 2024-03-18T18:25:21.619 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2024-03-18T18:25:21.839 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:21.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:22.646 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (1027 ms) 2024-03-18T18:25:22.646 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SetMountTimeout 2024-03-18T18:25:23.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SetMountTimeout (1033 ms) 2024-03-18T18:25:23.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.FsCrypt 2024-03-18T18:25:24.754 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.FsCrypt (1075 ms) 2024-03-18T18:25:24.754 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2024-03-18T18:25:25.784 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrs (1030 ms) 2024-03-18T18:25:25.785 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2024-03-18T18:25:26.815 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1031 ms) 2024-03-18T18:25:26.815 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2024-03-18T18:25:27.845 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1030 ms) 2024-03-18T18:25:27.845 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2024-03-18T18:25:28.875 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1030 ms) 2024-03-18T18:25:28.875 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 94 tests from LibCephFS (92876 ms total) 2024-03-18T18:25:28.875 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:25:28.875 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from AccessTest 2024-03-18T18:25:28.875 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] AccessTest.Foo 2024-03-18T18:25:28.917 INFO:tasks.workunit.client.0.smithi094.stdout:out: [{"entity":"client.libcephfs_foo_test.132248274","key":"AQAYh/hlAJUqNhAApfrvoOTdW/ozHDlWZf5W9g==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2024-03-18T18:25:28.917 INFO:tasks.workunit.client.0.smithi094.stdout:key: AQAYh/hlAJUqNhAApfrvoOTdW/ozHDlWZf5W9g== 2024-03-18T18:25:28.972 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] AccessTest.Foo (96 ms) 2024-03-18T18:25:28.972 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] AccessTest.Path 2024-03-18T18:25:29.062 INFO:tasks.workunit.client.0.smithi094.stdout:out: [{"entity":"client.libcephfs_path_test.1279738861","key":"AQAZh/hl8lpLAxAAlmhYpgov5E2rd4npLz8zHg==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.176425952","mon":"allow r","osd":"allow rwx"}}] 2024-03-18T18:25:29.062 INFO:tasks.workunit.client.0.smithi094.stdout:key: AQAZh/hl8lpLAxAAlmhYpgov5E2rd4npLz8zHg== 2024-03-18T18:25:30.364 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] AccessTest.Path (1393 ms) 2024-03-18T18:25:30.364 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] AccessTest.ReadOnly 2024-03-18T18:25:30.491 INFO:tasks.workunit.client.0.smithi094.stdout:out: [{"entity":"client.libcephfs_readonly_test.994268518","key":"AQAah/hleXrSHBAAHkmt2CsUIPBjKm7Bh2PkpQ==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2024-03-18T18:25:30.491 INFO:tasks.workunit.client.0.smithi094.stdout:key: AQAah/hleXrSHBAAHkmt2CsUIPBjKm7Bh2PkpQ== 2024-03-18T18:25:30.619 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] AccessTest.ReadOnly (255 ms) 2024-03-18T18:25:30.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] AccessTest.User 2024-03-18T18:25:30.744 INFO:tasks.workunit.client.0.smithi094.stdout:out: [{"entity":"client.libcephfs_user_test.29584350","key":"AQAah/hlVl8RLBAAhI7PCNshrEABDEyE3JG29w==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2024-03-18T18:25:30.745 INFO:tasks.workunit.client.0.smithi094.stdout:key: AQAah/hlVl8RLBAAhI7PCNshrEABDEyE3JG29w== 2024-03-18T18:25:30.998 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] AccessTest.User (368 ms) 2024-03-18T18:25:30.999 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from AccessTest (2123 ms total) 2024-03-18T18:25:30.999 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-03-18T18:25:30.999 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-03-18T18:25:30.999 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 98 tests from 2 test suites ran. (94999 ms total) 2024-03-18T18:25:30.999 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 98 tests. 2024-03-18T18:25:31.044 DEBUG:teuthology.orchestra.run:got remote process result: 139 2024-03-18T18:25:31.045 INFO:tasks.workunit.client.0.smithi094.stderr:Segmentation fault (core dumped) 2024-03-18T18:25:31.045 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2024-03-18T18:25:31.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-18T18:25:31.317 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi094 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49bdc51142759622a281d3e5327eebd07cbb8bb3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2024-03-18T18:25:31.527 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a37abbc10d5944bfb0d8923dd1918de5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_49bdc51142759622a281d3e5327eebd07cbb8bb3/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi094 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49bdc51142759622a281d3e5327eebd07cbb8bb3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh' 2024-03-18T18:25:31.530 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-18T18:25:31.539 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:25:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.659+0000 7f8282518700 1 Processor -- start 2024-03-18T18:25:31.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- start start 2024-03-18T18:25:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c0b6230 0x7f827c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f827c147b00 0x7f827c147f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0b73e0 con 0x7f827c0b39b0 2024-03-18T18:25:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c1484c0 con 0x7f827c147b00 2024-03-18T18:25:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0b21e0 con 0x7f827c0b6230 2024-03-18T18:25:31.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f827c147b00 0x7f827c147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8280ab5700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f827c0b39b0 0x7f827c0b3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36312/0 (socket says 172.21.15.94:36312) 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8280ab5700 1 -- 172.21.15.94:0/767568776 learned_addr learned my addr 172.21.15.94:0/767568776 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827bfff700 1 --2- 172.21.15.94:0/767568776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c0b6230 0x7f827c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827b7fe700 1 -- 172.21.15.94:0/767568776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c0b6230 msgr2=0x7f827c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827b7fe700 1 --2- 172.21.15.94:0/767568776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c0b6230 0x7f827c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827b7fe700 1 -- 172.21.15.94:0/767568776 >> v1:172.21.15.94:6789/0 conn(0x7f827c0b39b0 legacy=0x7f827c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827b7fe700 1 -- 172.21.15.94:0/767568776 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0b7070 con 0x7f827c147b00 2024-03-18T18:25:31.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827affd700 1 -- 172.21.15.94:0/767568776 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560195316 0 0) 0x7f827c0b73e0 con 0x7f827c0b39b0 2024-03-18T18:25:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827b7fe700 1 --2- 172.21.15.94:0/767568776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c147b00 0x7f827c147f80 secure :-1 s=READY pgs=4470 cs=0 l=1 rev1=1 crypto rx=0x7f8274009dc0 tx=0x7f827400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ff57a7c3aeb3e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827affd700 1 -- 172.21.15.94:0/767568776 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827400e070 con 0x7f827c147b00 2024-03-18T18:25:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827affd700 1 -- 172.21.15.94:0/767568776 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827400bae0 con 0x7f827c147b00 2024-03-18T18:25:31.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f827affd700 1 -- 172.21.15.94:0/767568776 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827400be90 con 0x7f827c147b00 2024-03-18T18:25:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- 172.21.15.94:0/767568776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c147b00 msgr2=0x7f827c147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:31.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 --2- 172.21.15.94:0/767568776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c147b00 0x7f827c147f80 secure :-1 s=READY pgs=4470 cs=0 l=1 rev1=1 crypto rx=0x7f8274009dc0 tx=0x7f827400b330 comp rx=0 tx=0).stop 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- 172.21.15.94:0/767568776 shutdown_connections 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 --2- 172.21.15.94:0/767568776 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c147b00 0x7f827c147f80 unknown :-1 s=CLOSED pgs=4470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 --2- 172.21.15.94:0/767568776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c0b6230 0x7f827c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- 172.21.15.94:0/767568776 >> 172.21.15.94:0/767568776 conn(0x7f827c06a570 msgr2=0x7f827c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- 172.21.15.94:0/767568776 shutdown_connections 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.663+0000 7f8282518700 1 -- 172.21.15.94:0/767568776 wait complete. 2024-03-18T18:25:31.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 Processor -- start 2024-03-18T18:25:31.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 -- start start 2024-03-18T18:25:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f827c0b39b0 0x7f827c0ba750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 0x7f827c1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c147b00 0x7f827c1de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c148900 con 0x7f827c0b6230 2024-03-18T18:25:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c149160 con 0x7f827c0b39b0 2024-03-18T18:25:31.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8282518700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c148b10 con 0x7f827c147b00 2024-03-18T18:25:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 0x7f827c1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 0x7f827c1495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40730/0 (socket says 172.21.15.94:40730) 2024-03-18T18:25:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 -- 172.21.15.94:0/3785359456 learned_addr learned my addr 172.21.15.94:0/3785359456 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8280ab5700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c147b00 0x7f827c1de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827bfff700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f827c0b39b0 0x7f827c0ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:31.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 -- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c147b00 msgr2=0x7f827c1de7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c147b00 0x7f827c1de7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 -- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f827c0b39b0 msgr2=0x7f827c0ba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f827c0b39b0 0x7f827c0ba750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 -- 172.21.15.94:0/3785359456 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009a70 con 0x7f827c0b6230 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827bfff700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f827c0b39b0 0x7f827c0ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f8280ab5700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c147b00 0x7f827c1de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:31.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.667+0000 7f827b7fe700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 0x7f827c1495f0 secure :-1 s=READY pgs=4471 cs=0 l=1 rev1=1 crypto rx=0x7f8274014040 tx=0x7f8274004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274027480 con 0x7f827c0b6230 2024-03-18T18:25:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8274020070 con 0x7f827c0b6230 2024-03-18T18:25:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c14ac40 con 0x7f827c0b6230 2024-03-18T18:25:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274027840 con 0x7f827c0b6230 2024-03-18T18:25:31.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c14a960 con 0x7f827c0b6230 2024-03-18T18:25:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c067100 con 0x7f827c0b6230 2024-03-18T18:25:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.671+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f827401b400 con 0x7f827c0b6230 2024-03-18T18:25:31.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.675+0000 7f8278ff9700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8260066730 0x7f8260068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.675+0000 7f827bfff700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8260066730 0x7f8260068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:31.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.675+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8274022070 con 0x7f827c0b6230 2024-03-18T18:25:31.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.675+0000 7f827bfff700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8260066730 0x7f8260068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8264009c40 tx=0x7f8264008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:31.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.683+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f82740535c0 con 0x7f827c0b6230 2024-03-18T18:25:31.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.855+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f827c1492a0 con 0x7f827c0b6230 2024-03-18T18:25:31.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8278ff9700 1 -- 172.21.15.94:0/3785359456 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16396 (secure 0 0 0) 0x7f8274056be0 con 0x7f827c0b6230 2024-03-18T18:25:31.860 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:31.861 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":54,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:25:28.990048+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":60,"length":6}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":64,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:25:31.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8260066730 msgr2=0x7f8260068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:31.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8260066730 0x7f8260068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8264009c40 tx=0x7f8264008040 comp rx=0 tx=0).stop 2024-03-18T18:25:31.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 msgr2=0x7f827c1495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:31.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 0x7f827c1495f0 secure :-1 s=READY pgs=4471 cs=0 l=1 rev1=1 crypto rx=0x7f8274014040 tx=0x7f8274004af0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 shutdown_connections 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8260066730 0x7f8260068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f827c147b00 0x7f827c1de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f827c0b6230 0x7f827c1495f0 unknown :-1 s=CLOSED pgs=4471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 --2- 172.21.15.94:0/3785359456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f827c0b39b0 0x7f827c0ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 >> 172.21.15.94:0/3785359456 conn(0x7f827c06a570 msgr2=0x7f827c0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 shutdown_connections 2024-03-18T18:25:31.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.859+0000 7f8282518700 1 -- 172.21.15.94:0/3785359456 wait complete. 2024-03-18T18:25:31.875 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T18:08:58.619045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T18:09:10.506373+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T18:09:11.785352+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 54, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T18:25:31.876 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T18:25:31.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f096a3a7700 1 Processor -- start 2024-03-18T18:25:31.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f096a3a7700 1 -- start start 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f096a3a7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f09640b8400 0x7f09640b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f096a3a7700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09640b34c0 con 0x7f09640bc730 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f096a3a7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09640bcb10 con 0x7f0964146ba0 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f096a3a7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09640b5f00 con 0x7f09640b8400 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f09693a5700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f09640bc730 0x7f0964146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36314/0 (socket says 172.21.15.94:36314) 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f09693a5700 1 -- 172.21.15.94:0/2494457585 learned_addr learned my addr 172.21.15.94:0/2494457585 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:31.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f0968ba4700 1 --2- 172.21.15.94:0/2494457585 >> v2:172.21.15.151:3300/0 conn(0x7f09640b8400 0x7f09640b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392085942 0 0) 0x7f09640b34c0 con 0x7f09640bc730 2024-03-18T18:25:32.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09500035d0 con 0x7f09640bc730 2024-03-18T18:25:32.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172951798 0 0) 0x7f09500035d0 con 0x7f09640bc730 2024-03-18T18:25:32.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 >> v2:172.21.15.151:3300/0 conn(0x7f09640b8400 msgr2=0x7f09640b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:32.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 --2- 172.21.15.94:0/2494457585 >> v2:172.21.15.151:3300/0 conn(0x7f09640b8400 0x7f09640b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 >> v1:172.21.15.151:6789/0 conn(0x7f0964146ba0 legacy=0x7f0964140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640b3710 con 0x7f09640bc730 2024-03-18T18:25:32.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f0954001670 con 0x7f09640bc730 2024-03-18T18:25:32.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 >> v1:172.21.15.94:6789/0 conn(0x7f09640bc730 legacy=0x7f0964146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950003a20 0x7f0950003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0950004870 0x7f0950004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0950005230 0x7f095000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095000c1a0 con 0x7f0950004870 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095000c310 con 0x7f0950005230 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095000c4d0 con 0x7f0950003a20 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.995+0000 7f0968ba4700 1 --2- 172.21.15.94:0/2494457585 >> v2:172.21.15.151:3300/0 conn(0x7f09640b8400 0x7f09640b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0950004870 0x7f0950004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0969ba6700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0950005230 0x7f095000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f09693a5700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950003a20 0x7f0950003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 -- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950003a20 msgr2=0x7f0950003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950003a20 0x7f0950003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 -- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0950005230 msgr2=0x7f095000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0950005230 0x7f095000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 -- 172.21.15.94:0/2494457585 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500035d0 con 0x7f0950004870 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0969ba6700 1 -- 172.21.15.94:0/2494457585 reap_dead start 2024-03-18T18:25:32.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f0968ba4700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0950004870 0x7f0950004cf0 secure :-1 s=READY pgs=4473 cs=0 l=1 rev1=1 crypto rx=0x7f0960009d20 tx=0x7f09500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427ac00687c0202b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960009e70 con 0x7f0950004870 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096000e9a0 con 0x7f0950004870 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f095bfff700 1 -- 172.21.15.94:0/2494457585 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000ed10 con 0x7f0950004870 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 -- 172.21.15.94:0/2494457585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0950004870 msgr2=0x7f0950004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0950004870 0x7f0950004cf0 secure :-1 s=READY pgs=4473 cs=0 l=1 rev1=1 crypto rx=0x7f0960009d20 tx=0x7f09500058a0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 -- 172.21.15.94:0/2494457585 shutdown_connections 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 --2- 172.21.15.94:0/2494457585 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0950004870 0x7f0950004cf0 unknown :-1 s=CLOSED pgs=4473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 -- 172.21.15.94:0/2494457585 >> 172.21.15.94:0/2494457585 conn(0x7f0964073600 msgr2=0x7f09640bbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 -- 172.21.15.94:0/2494457585 shutdown_connections 2024-03-18T18:25:32.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 -- 172.21.15.94:0/2494457585 wait complete. 2024-03-18T18:25:32.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 Processor -- start 2024-03-18T18:25:32.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:31.999+0000 7f096a3a7700 1 -- start start 2024-03-18T18:25:32.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950004870 0x7f09641dc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 0x7f09640baab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09640bb3d0 0x7f0964140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09641db8c0 con 0x7f09640b25c0 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964142750 con 0x7f09640bb3d0 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09641dbb30 con 0x7f0950004870 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 0x7f09640baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 0x7f09640baab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40746/0 (socket says 172.21.15.94:40746) 2024-03-18T18:25:32.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 -- 172.21.15.94:0/4137196458 learned_addr learned my addr 172.21.15.94:0/4137196458 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0969ba6700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09640bb3d0 0x7f0964140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f09693a5700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950004870 0x7f09641dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 -- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950004870 msgr2=0x7f09641dc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950004870 0x7f09641dc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 -- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09640bb3d0 msgr2=0x7f0964140f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09640bb3d0 0x7f0964140f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 -- 172.21.15.94:0/4137196458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09641dbe10 con 0x7f09640b25c0 2024-03-18T18:25:32.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f09693a5700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950004870 0x7f09641dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0968ba4700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 0x7f09640baab0 secure :-1 s=READY pgs=4474 cs=0 l=1 rev1=1 crypto rx=0x7f096000e790 tx=0x7f09600047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960003ad0 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960003c50 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09641db8c0 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960009e70 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.003+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09640bb850 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.007+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0960013470 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.007+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09641dbfa0 con 0x7f09640b25c0 2024-03-18T18:25:32.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.007+0000 7f0959ffb700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0948066730 0x7f0948068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.007+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0960085c40 con 0x7f09640b25c0 2024-03-18T18:25:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.007+0000 7f09693a5700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0948066730 0x7f0948068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.007+0000 7f09693a5700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0948066730 0x7f0948068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0954000c00 tx=0x7f0954009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.015+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0960052f10 con 0x7f09640b25c0 2024-03-18T18:25:32.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.187+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0964074440 con 0x7f09640b25c0 2024-03-18T18:25:32.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.187+0000 7f0959ffb700 1 -- 172.21.15.94:0/4137196458 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0960056530 con 0x7f09640b25c0 2024-03-18T18:25:32.190 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 1 2024-03-18T18:25:32.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.187+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0948066730 msgr2=0x7f0948068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.187+0000 7f096a3a7700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0948066730 0x7f0948068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0954000c00 tx=0x7f0954009040 comp rx=0 tx=0).stop 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 msgr2=0x7f09640baab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 0x7f09640baab0 secure :-1 s=READY pgs=4474 cs=0 l=1 rev1=1 crypto rx=0x7f096000e790 tx=0x7f09600047e0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 shutdown_connections 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0948066730 0x7f0948068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09640bb3d0 0x7f0964140f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09640b25c0 0x7f09640baab0 unknown :-1 s=CLOSED pgs=4474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 --2- 172.21.15.94:0/4137196458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0950004870 0x7f09641dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 >> 172.21.15.94:0/4137196458 conn(0x7f0964073600 msgr2=0x7f096413d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 shutdown_connections 2024-03-18T18:25:32.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.191+0000 7f096a3a7700 1 -- 172.21.15.94:0/4137196458 wait complete. 2024-03-18T18:25:32.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T18:25:32.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.315+0000 7f02e4e56700 1 Processor -- start 2024-03-18T18:25:32.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.315+0000 7f02e4e56700 1 -- start start 2024-03-18T18:25:32.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02e00b2180 0x7f02e00b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e006fff0 con 0x7f02e00b2d40 2024-03-18T18:25:32.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00b9790 con 0x7f02e00b93b0 2024-03-18T18:25:32.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e013d9f0 con 0x7f02e00b2180 2024-03-18T18:25:32.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02deffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f02e00b2d40 0x7f02e01431c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36322/0 (socket says 172.21.15.94:36322) 2024-03-18T18:25:32.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02deffd700 1 -- 172.21.15.94:0/4009891231 learned_addr learned my addr 172.21.15.94:0/4009891231 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:32.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02dffff700 1 --2- 172.21.15.94:0/4009891231 >> v2:172.21.15.94:3300/0 conn(0x7f02e00b2180 0x7f02e00b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02dffff700 1 -- 172.21.15.94:0/4009891231 >> v1:172.21.15.151:6789/0 conn(0x7f02e00b93b0 legacy=0x7f02e00b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02dffff700 1 -- 172.21.15.94:0/4009891231 >> v1:172.21.15.94:6789/0 conn(0x7f02e00b2d40 legacy=0x7f02e01431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02de7fc700 1 -- 172.21.15.94:0/4009891231 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186830198 0 0) 0x7f02e00b9790 con 0x7f02e00b93b0 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02dffff700 1 -- 172.21.15.94:0/4009891231 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0070240 con 0x7f02e00b2180 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02dffff700 1 --2- 172.21.15.94:0/4009891231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2180 0x7f02e00b25b0 secure :-1 s=READY pgs=4476 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009850 tx=0x7f02d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b423fd727d2ccf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02de7fc700 1 -- 172.21.15.94:0/4009891231 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0004230 con 0x7f02e00b2180 2024-03-18T18:25:32.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02de7fc700 1 -- 172.21.15.94:0/4009891231 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d0004390 con 0x7f02e00b2180 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02de7fc700 1 -- 172.21.15.94:0/4009891231 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00036c0 con 0x7f02e00b2180 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- 172.21.15.94:0/4009891231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2180 msgr2=0x7f02e00b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 --2- 172.21.15.94:0/4009891231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2180 0x7f02e00b25b0 secure :-1 s=READY pgs=4476 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009850 tx=0x7f02d0009b60 comp rx=0 tx=0).stop 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- 172.21.15.94:0/4009891231 shutdown_connections 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 --2- 172.21.15.94:0/4009891231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2180 0x7f02e00b25b0 unknown :-1 s=CLOSED pgs=4476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- 172.21.15.94:0/4009891231 >> 172.21.15.94:0/4009891231 conn(0x7f02e00b5b60 msgr2=0x7f02e00b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- 172.21.15.94:0/4009891231 shutdown_connections 2024-03-18T18:25:32.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.319+0000 7f02e4e56700 1 -- 172.21.15.94:0/4009891231 wait complete. 2024-03-18T18:25:32.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 Processor -- start 2024-03-18T18:25:32.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 -- start start 2024-03-18T18:25:32.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00b2180 0x7f02e01def00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 0x7f02e01df440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00b93b0 0x7f02e013b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00b5270 con 0x7f02e00b2d40 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0144d00 con 0x7f02e00b93b0 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e013c570 con 0x7f02e00b2180 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 0x7f02e01df440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 0x7f02e01df440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40766/0 (socket says 172.21.15.94:40766) 2024-03-18T18:25:32.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 -- 172.21.15.94:0/3441799705 learned_addr learned my addr 172.21.15.94:0/3441799705 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02df7fe700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00b2180 0x7f02e01def00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02dffff700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00b93b0 0x7f02e013b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 -- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00b2180 msgr2=0x7f02e01def00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00b2180 0x7f02e01def00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 -- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00b93b0 msgr2=0x7f02e013b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00b93b0 0x7f02e013b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 -- 172.21.15.94:0/3441799705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d00094b0 con 0x7f02e00b2d40 2024-03-18T18:25:32.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02deffd700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 0x7f02e01df440 secure :-1 s=READY pgs=4477 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c780 tx=0x7f02c800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8004ca0 con 0x7f02e00b2d40 2024-03-18T18:25:32.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8004e00 con 0x7f02e00b2d40 2024-03-18T18:25:32.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e01444c0 con 0x7f02e00b2d40 2024-03-18T18:25:32.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8007310 con 0x7f02e00b2d40 2024-03-18T18:25:32.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.323+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e0145e20 con 0x7f02e00b2d40 2024-03-18T18:25:32.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.327+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e0144e40 con 0x7f02e00b2d40 2024-03-18T18:25:32.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.327+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f02c8007470 con 0x7f02e00b2d40 2024-03-18T18:25:32.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.327+0000 7f02d7fff700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02c0066760 0x7f02c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.327+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f02c8083e80 con 0x7f02e00b2d40 2024-03-18T18:25:32.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.331+0000 7f02df7fe700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02c0066760 0x7f02c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.331+0000 7f02df7fe700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02c0066760 0x7f02c0068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02d80012e0 tx=0x7f02d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.335+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f02e0144e40 con 0x7f02e00b2d40 2024-03-18T18:25:32.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.503+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02e0144e40 con 0x7f02e00b2d40 2024-03-18T18:25:32.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.503+0000 7f02d7fff700 1 -- 172.21.15.94:0/3441799705 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02e0144e40 con 0x7f02e00b2d40 2024-03-18T18:25:32.507 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 32 2024-03-18T18:25:32.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02c0066760 msgr2=0x7f02c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02c0066760 0x7f02c0068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f02d80012e0 tx=0x7f02d8009040 comp rx=0 tx=0).stop 2024-03-18T18:25:32.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 msgr2=0x7f02e01df440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 0x7f02e01df440 secure :-1 s=READY pgs=4477 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c780 tx=0x7f02c800ca90 comp rx=0 tx=0).stop 2024-03-18T18:25:32.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 shutdown_connections 2024-03-18T18:25:32.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02c0066760 0x7f02c0068c20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00b93b0 0x7f02e013b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02e00b2d40 0x7f02e01df440 unknown :-1 s=CLOSED pgs=4477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 --2- 172.21.15.94:0/3441799705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00b2180 0x7f02e01def00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 >> 172.21.15.94:0/3441799705 conn(0x7f02e00b5b60 msgr2=0x7f02e006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 shutdown_connections 2024-03-18T18:25:32.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.507+0000 7f02e4e56700 1 -- 172.21.15.94:0/3441799705 wait complete. 2024-03-18T18:25:32.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T18:25:32.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d682c700 1 Processor -- start 2024-03-18T18:25:32.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d682c700 1 -- start start 2024-03-18T18:25:32.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d682c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84d006a3c0 0x7f84d0146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d682c700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d00b8590 con 0x7f84d009dd40 2024-03-18T18:25:32.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d682c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d01472c0 con 0x7f84d00b6c80 2024-03-18T18:25:32.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d682c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d009bb60 con 0x7f84d006a3c0 2024-03-18T18:25:32.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d602b700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f84d009dd40 0x7f84d0150f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:36328/0 (socket says 172.21.15.94:36328) 2024-03-18T18:25:32.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d602b700 1 -- 172.21.15.94:0/1047784905 learned_addr learned my addr 172.21.15.94:0/1047784905 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.639+0000 7f84d582a700 1 --2- 172.21.15.94:0/1047784905 >> v2:172.21.15.151:3300/0 conn(0x7f84d006a3c0 0x7f84d0146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249295511 0 0) 0x7f84d00b8590 con 0x7f84d009dd40 2024-03-18T18:25:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84bc0035d0 con 0x7f84d009dd40 2024-03-18T18:25:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565953242 0 0) 0x7f84d01472c0 con 0x7f84d00b6c80 2024-03-18T18:25:32.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d00b8590 con 0x7f84d00b6c80 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d582a700 1 -- 172.21.15.94:0/1047784905 >> v1:172.21.15.151:6789/0 conn(0x7f84d00b6c80 legacy=0x7f84d009d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d582a700 1 -- 172.21.15.94:0/1047784905 >> v1:172.21.15.94:6789/0 conn(0x7f84d009dd40 legacy=0x7f84d0150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d582a700 1 -- 172.21.15.94:0/1047784905 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d006a7a0 con 0x7f84d006a3c0 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d582a700 1 --2- 172.21.15.94:0/1047784905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d0146690 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009850 tx=0x7f84c0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d0fb81211e7ae6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011830 con 0x7f84d006a3c0 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c0011990 con 0x7f84d006a3c0 2024-03-18T18:25:32.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d4828700 1 -- 172.21.15.94:0/1047784905 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011d40 con 0x7f84d006a3c0 2024-03-18T18:25:32.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- 172.21.15.94:0/1047784905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 msgr2=0x7f84d0146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 --2- 172.21.15.94:0/1047784905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d0146690 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009850 tx=0x7f84c0009b60 comp rx=0 tx=0).stop 2024-03-18T18:25:32.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- 172.21.15.94:0/1047784905 shutdown_connections 2024-03-18T18:25:32.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 --2- 172.21.15.94:0/1047784905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d0146690 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- 172.21.15.94:0/1047784905 >> 172.21.15.94:0/1047784905 conn(0x7f84d00bbda0 msgr2=0x7f84d00bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- 172.21.15.94:0/1047784905 shutdown_connections 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- 172.21.15.94:0/1047784905 wait complete. 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 Processor -- start 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- start start 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d01df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 0x7f84d0148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84d00b6c80 0x7f84d01db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01dbc10 con 0x7f84d009dd40 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01ded60 con 0x7f84d006a3c0 2024-03-18T18:25:32.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.643+0000 7f84d682c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01defd0 con 0x7f84d00b6c80 2024-03-18T18:25:32.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 0x7f84d0148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d582a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d01df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 0x7f84d0148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40778/0 (socket says 172.21.15.94:40778) 2024-03-18T18:25:32.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 -- 172.21.15.94:0/3101217723 learned_addr learned my addr 172.21.15.94:0/3101217723 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:32.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d602b700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84d00b6c80 0x7f84d01db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 -- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84d00b6c80 msgr2=0x7f84d01db6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84d00b6c80 0x7f84d01db6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 -- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 msgr2=0x7f84d01df7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d01df7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 -- 172.21.15.94:0/3101217723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00094b0 con 0x7f84d009dd40 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d582a700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d01df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d5029700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 0x7f84d0148cc0 secure :-1 s=READY pgs=4479 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c4c0 tx=0x7f84cc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0052d0 con 0x7f84d009dd40 2024-03-18T18:25:32.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d01df2b0 con 0x7f84d009dd40 2024-03-18T18:25:32.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d009a140 con 0x7f84d009dd40 2024-03-18T18:25:32.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00ce90 con 0x7f84d009dd40 2024-03-18T18:25:32.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0036a0 con 0x7f84d009dd40 2024-03-18T18:25:32.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.647+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b8005310 con 0x7f84d009dd40 2024-03-18T18:25:32.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.651+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f84cc003800 con 0x7f84d009dd40 2024-03-18T18:25:32.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.651+0000 7f84c67fc700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f84b4066730 0x7f84b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.651+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f84cc0834b0 con 0x7f84d009dd40 2024-03-18T18:25:32.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.651+0000 7f84d582a700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f84b4066730 0x7f84b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.651+0000 7f84d582a700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f84b4066730 0x7f84b4068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f84c00090b0 tx=0x7f84c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.659+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f84cc050800 con 0x7f84d009dd40 2024-03-18T18:25:32.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.831+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84b8005b40 con 0x7f84d009dd40 2024-03-18T18:25:32.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.835+0000 7f84c67fc700 1 -- 172.21.15.94:0/3101217723 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84cc053e20 con 0x7f84d009dd40 2024-03-18T18:25:32.837 INFO:teuthology.orchestra.run.smithi094.stdout:pg_num: 64 2024-03-18T18:25:32.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f84b4066730 msgr2=0x7f84b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f84b4066730 0x7f84b4068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f84c00090b0 tx=0x7f84c0008030 comp rx=0 tx=0).stop 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 msgr2=0x7f84d0148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 0x7f84d0148cc0 secure :-1 s=READY pgs=4479 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c4c0 tx=0x7f84cc00c7d0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 shutdown_connections 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f84b4066730 0x7f84b4068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84d00b6c80 0x7f84d01db6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84d009dd40 0x7f84d0148cc0 secure :-1 s=CLOSED pgs=4479 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c4c0 tx=0x7f84cc00c7d0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 --2- 172.21.15.94:0/3101217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d006a3c0 0x7f84d01df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 >> 172.21.15.94:0/3101217723 conn(0x7f84d00bbda0 msgr2=0x7f84d009c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 shutdown_connections 2024-03-18T18:25:32.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.839+0000 7f84d682c700 1 -- 172.21.15.94:0/3101217723 wait complete. 2024-03-18T18:25:32.860 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-18T18:25:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 Processor -- start 2024-03-18T18:25:32.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 -- start start 2024-03-18T18:25:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f02d809ac60 0x7f02d80b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02d80b8270 0x7f02d81403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d80bb6b0 0x7f02d8140930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d8140e70 con 0x7f02d80b8270 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d80b9be0 con 0x7f02d809ac60 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de960700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80ba110 con 0x7f02d80bb6b0 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02d80b8270 0x7f02d81403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f02d80b8270 0x7f02d81403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40784/0 (socket says 172.21.15.94:40784) 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 -- 172.21.15.94:0/2429101347 learned_addr learned my addr 172.21.15.94:0/2429101347 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd95e700 1 --2- 172.21.15.94:0/2429101347 >> v2:172.21.15.151:3300/0 conn(0x7f02d809ac60 0x7f02d80b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02de15f700 1 --2- 172.21.15.94:0/2429101347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d80bb6b0 0x7f02d8140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 -- 172.21.15.94:0/2429101347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d80bb6b0 msgr2=0x7f02d8140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:32.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 --2- 172.21.15.94:0/2429101347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d80bb6b0 0x7f02d8140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 -- 172.21.15.94:0/2429101347 >> v2:172.21.15.151:3300/0 conn(0x7f02d809ac60 msgr2=0x7f02d80b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:32.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 --2- 172.21.15.94:0/2429101347 >> v2:172.21.15.151:3300/0 conn(0x7f02d809ac60 0x7f02d80b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 -- 172.21.15.94:0/2429101347 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d809b040 con 0x7f02d80b8270 2024-03-18T18:25:32.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dd15d700 1 --2- 172.21.15.94:0/2429101347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80b8270 0x7f02d81403f0 secure :-1 s=READY pgs=4480 cs=0 l=1 rev1=1 crypto rx=0x7f02d806b390 tx=0x7f02d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4755408d3eaea2e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dc95c700 1 -- 172.21.15.94:0/2429101347 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400e070 con 0x7f02d80b8270 2024-03-18T18:25:32.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dc95c700 1 -- 172.21.15.94:0/2429101347 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d400b910 con 0x7f02d80b8270 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.967+0000 7f02dc95c700 1 -- 172.21.15.94:0/2429101347 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400bcc0 con 0x7f02d80b8270 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/2429101347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80b8270 msgr2=0x7f02d81403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- 172.21.15.94:0/2429101347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80b8270 0x7f02d81403f0 secure :-1 s=READY pgs=4480 cs=0 l=1 rev1=1 crypto rx=0x7f02d806b390 tx=0x7f02d400b330 comp rx=0 tx=0).stop 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/2429101347 shutdown_connections 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- 172.21.15.94:0/2429101347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d80bb6b0 0x7f02d8140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- 172.21.15.94:0/2429101347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80b8270 0x7f02d81403f0 unknown :-1 s=CLOSED pgs=4480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- 172.21.15.94:0/2429101347 >> v2:172.21.15.151:3300/0 conn(0x7f02d809ac60 0x7f02d80b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/2429101347 >> 172.21.15.94:0/2429101347 conn(0x7f02d809dbf0 msgr2=0x7f02d809dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:32.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/2429101347 shutdown_connections 2024-03-18T18:25:32.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/2429101347 wait complete. 2024-03-18T18:25:32.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 Processor -- start 2024-03-18T18:25:32.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- start start 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d809ac60 0x7f02d809c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d80b8270 0x7f02d813f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 0x7f02d813f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d814a690 con 0x7f02d80bb6b0 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d81498d0 con 0x7f02d80b8270 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d814a040 con 0x7f02d809ac60 2024-03-18T18:25:32.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 0x7f02d813f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 0x7f02d813f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:40790/0 (socket says 172.21.15.94:40790) 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 -- 172.21.15.94:0/3077587951 learned_addr learned my addr 172.21.15.94:0/3077587951 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02dd95e700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d809ac60 0x7f02d809c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02dd15d700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d80b8270 0x7f02d813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 -- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d809ac60 msgr2=0x7f02d809c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d809ac60 0x7f02d809c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 -- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d80b8270 msgr2=0x7f02d813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d80b8270 0x7f02d813f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:32.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 -- 172.21.15.94:0/3077587951 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4009b30 con 0x7f02d80bb6b0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de15f700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 0x7f02d813f940 secure :-1 s=READY pgs=4481 cs=0 l=1 rev1=1 crypto rx=0x7f02d000e7f0 tx=0x7f02d000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00095c0 con 0x7f02d80bb6b0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d0013680 con 0x7f02d80bb6b0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d814a320 con 0x7f02d80bb6b0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0013a10 con 0x7f02d80bb6b0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.971+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d8149530 con 0x7f02d80bb6b0 2024-03-18T18:25:32.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.975+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d8067620 con 0x7f02d80bb6b0 2024-03-18T18:25:32.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.975+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f02d0013b90 con 0x7f02d80bb6b0 2024-03-18T18:25:32.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.975+0000 7f02ca7fc700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02bc066730 0x7f02bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:32.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.975+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f02d0084490 con 0x7f02d80bb6b0 2024-03-18T18:25:32.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.975+0000 7f02dd95e700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02bc066730 0x7f02bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:32.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.975+0000 7f02dd95e700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02bc066730 0x7f02bc068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009ad0 tx=0x7f02cc009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:32.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:32.987+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f02d00516b0 con 0x7f02d80bb6b0 2024-03-18T18:25:33.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.199+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f02d814a7d0 con 0x7f02d80bb6b0 2024-03-18T18:25:33.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.207+0000 7f02ca7fc700 1 -- 172.21.15.94:0/3077587951 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v6) v1 ==== 81+0+447455 (secure 0 0 0) 0x7f02d814a7d0 con 0x7f02d80bb6b0 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: "epoch": 6, 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: "active_gid": 4101, 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: "active_name": "y", 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: "active_addrs": { 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: "addrvec": [ 2024-03-18T18:25:33.215 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v2", 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:6832", 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 25889 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:6833", 2024-03-18T18:25:33.216 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 25889 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: "active_addr": "172.21.15.94:6833/25889", 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: "active_change": "2024-03-18T18:08:52.541660+0000", 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: "active_mgr_features": 4540138322906710015, 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: "available": true, 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: "standbys": [ 2024-03-18T18:25:33.217 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "gid": 4117, 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "x", 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "mgr_features": 4540138322906710015, 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "available_modules": [ 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "alerts", 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.218 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.219 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How frequently to reexamine health status", 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.220 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.221 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.222 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.223 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.224 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.225 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.226 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.227 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_destination": { 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_destination", 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.228 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Email address to send alerts to", 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_from_name": { 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_from_name", 2024-03-18T18:25:33.229 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "Ceph", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Email From: name", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.230 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_host": { 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_host", 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.231 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SMTP server", 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_password": { 2024-03-18T18:25:33.232 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_password", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Password to authenticate with", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.233 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_port": { 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_port", 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "465", 2024-03-18T18:25:33.234 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SMTP port", 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_sender": { 2024-03-18T18:25:33.235 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_sender", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SMTP envelope sender", 2024-03-18T18:25:33.236 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_ssl": { 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_ssl", 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.237 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.238 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_user": { 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_user", 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.239 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "User to authenticate as", 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.240 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "balancer", 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "active": { 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "active", 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.241 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "automatically balance PGs across cluster", 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "begin_time": { 2024-03-18T18:25:33.242 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "begin_time", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0000", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "beginning time of day to automatically balance", 2024-03-18T18:25:33.243 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "begin_weekday": { 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "begin_weekday", 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.244 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "0", 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "6", 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.245 INFO:teuthology.orchestra.run.smithi094.stdout: "crush_compat_max_iterations": { 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crush_compat_max_iterations", 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "25", 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "250", 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.246 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "crush_compat_metrics": { 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crush_compat_metrics", 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.247 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "pgs,objects,bytes", 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.248 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "crush_compat_step": { 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crush_compat_step", 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0.5", 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "0.001", 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "0.999", 2024-03-18T18:25:33.249 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "aggressiveness of optimization", 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "end_time": { 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "end_time", 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.250 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "2359", 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "ending time of day to automatically balance", 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.251 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "end_weekday": { 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "end_weekday", 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.252 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "0", 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "6", 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.253 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.254 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.255 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.256 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.257 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.258 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.259 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.260 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "min_score": { 2024-03-18T18:25:33.261 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "min_score", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-18T18:25:33.262 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "mode": { 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mode", 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.263 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "upmap", 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "crush-compat", 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "none", 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "upmap" 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Balancer mode", 2024-03-18T18:25:33.264 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "pool_ids": { 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pool_ids", 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.265 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.267 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.268 INFO:teuthology.orchestra.run.smithi094.stdout: "upmap_max_deviation": { 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "upmap_max_deviation", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-18T18:25:33.269 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "upmap_max_optimizations": { 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "upmap_max_optimizations", 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.270 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.271 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cephadm", 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.272 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "agent_down_multiplier": { 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "agent_down_multiplier", 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "3.0", 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.273 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "agent_refresh_rate": { 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "agent_refresh_rate", 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.274 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "20", 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.275 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "agent_starting_port": { 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "agent_starting_port", 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "4721", 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.276 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "allow_ptrace": { 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "allow_ptrace", 2024-03-18T18:25:33.277 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-18T18:25:33.278 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "autotune_interval": { 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "autotune_interval", 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.279 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.280 INFO:teuthology.orchestra.run.smithi094.stdout: "autotune_memory_target_ratio": { 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "autotune_memory_target_ratio", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0.7", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-18T18:25:33.281 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "cgroups_split": { 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cgroups_split", 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.282 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.283 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "config_checks_enabled": { 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "config_checks_enabled", 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.284 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "config_dashboard": { 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "config_dashboard", 2024-03-18T18:25:33.285 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.286 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.286 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.286 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.286 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.286 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.286 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_alertmanager": { 2024-03-18T18:25:33.287 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_alertmanager", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.288 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_base": { 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_base", 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-18T18:25:33.289 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Container image name, without the tag", 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_elasticsearch": { 2024-03-18T18:25:33.290 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_elasticsearch", 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.291 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "elasticsearch container image", 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_grafana": { 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_grafana", 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.292 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_haproxy": { 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_haproxy", 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.294 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "HAproxy container image", 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_jaeger_agent": { 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_jaeger_agent", 2024-03-18T18:25:33.295 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Jaeger agent container image", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.296 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_jaeger_collector": { 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_jaeger_collector", 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-18T18:25:33.297 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Jaeger collector container image", 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_jaeger_query": { 2024-03-18T18:25:33.298 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_jaeger_query", 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.299 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Jaeger query container image", 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_keepalived": { 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_keepalived", 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.300 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Keepalived container image", 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.301 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_loki": { 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_loki", 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.302 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Loki container image", 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_node_exporter": { 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_node_exporter", 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.303 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.304 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_nvmeof": { 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_nvmeof", 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.305 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Nvme-of container image", 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_prometheus": { 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_prometheus", 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.306 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.307 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_promtail": { 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_promtail", 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.308 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Promtail container image", 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_snmp_gateway": { 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_snmp_gateway", 2024-03-18T18:25:33.309 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SNMP Gateway container image", 2024-03-18T18:25:33.310 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "container_init": { 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_init", 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.311 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Run podman/docker with `--init`", 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "daemon_cache_timeout": { 2024-03-18T18:25:33.312 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "daemon_cache_timeout", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.313 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "default_cephadm_command_timeout": { 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "default_cephadm_command_timeout", 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "900", 2024-03-18T18:25:33.314 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.315 INFO:teuthology.orchestra.run.smithi094.stdout: "default_registry": { 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "default_registry", 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io", 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.316 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "device_cache_timeout": { 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "device_cache_timeout", 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.317 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "1800", 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "seconds to cache device inventory", 2024-03-18T18:25:33.318 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "device_enhanced_scan": { 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "device_enhanced_scan", 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.319 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "facts_cache_timeout": { 2024-03-18T18:25:33.320 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "facts_cache_timeout", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "seconds to cache host facts data", 2024-03-18T18:25:33.321 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "host_check_interval": { 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "host_check_interval", 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.322 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to perform a host check", 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.323 INFO:teuthology.orchestra.run.smithi094.stdout: "hw_monitoring": { 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "hw_monitoring", 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.324 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "inventory_list_all": { 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "inventory_list_all", 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.325 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.326 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.327 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.328 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "log_refresh_metadata": { 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_refresh_metadata", 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.329 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.330 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-18T18:25:33.331 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.332 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.333 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.334 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.335 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.336 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.337 INFO:teuthology.orchestra.run.smithi094.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "*", 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.338 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "max_count_per_host": { 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_count_per_host", 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.339 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "max number of daemons per service per host", 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.340 INFO:teuthology.orchestra.run.smithi094.stdout: "max_osd_draining_count": { 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_osd_draining_count", 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.341 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "migration_current": { 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "migration_current", 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.342 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "internal - do not modify", 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.343 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "mode": { 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mode", 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "root", 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.344 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "cephadm-package", 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "root" 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "mode for remote execution of cephadm", 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.345 INFO:teuthology.orchestra.run.smithi094.stdout: "oob_default_addr": { 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "oob_default_addr", 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "169.254.1.1", 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.346 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "prometheus_alerts_path": { 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "prometheus_alerts_path", 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.347 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.348 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_insecure": { 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_insecure", 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.349 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_password": { 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_password", 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.350 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.351 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_url": { 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_url", 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.352 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_username": { 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_username", 2024-03-18T18:25:33.353 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.354 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "secure_monitoring_stack": { 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "secure_monitoring_stack", 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.355 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "service_discovery_port": { 2024-03-18T18:25:33.356 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "service_discovery_port", 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8765", 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.357 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "cephadm service discovery port", 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "ssh_config_file": { 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssh_config_file", 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.358 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.359 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "use_agent": { 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "use_agent", 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.360 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "use_repo_digest": { 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "use_repo_digest", 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.361 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.362 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_on_failed_host_check": { 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_on_failed_host_check", 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.363 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise a health warning if the host check fails", 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.364 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_on_stray_daemons": { 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_on_stray_daemons", 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.365 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_on_stray_hosts": { 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_on_stray_hosts", 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.366 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.367 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crash", 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.368 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.369 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.370 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.371 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.372 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.373 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.374 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.375 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.376 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "retain_interval": { 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "retain_interval", 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "31536000", 2024-03-18T18:25:33.377 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_recent_interval": { 2024-03-18T18:25:33.378 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_recent_interval", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "1209600", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-18T18:25:33.379 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "dashboard", 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.380 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.381 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "ALERTMANAGER_API_HOST": { 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-18T18:25:33.382 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.383 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.384 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "AUDIT_API_ENABLED": { 2024-03-18T18:25:33.385 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "AUDIT_API_ENABLED", 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.386 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-18T18:25:33.387 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.388 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "ENABLE_BROWSABLE_API": { 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.389 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.390 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.391 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.392 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-18T18:25:33.393 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.394 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.395 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.396 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.397 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-18T18:25:33.398 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.399 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.400 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-18T18:25:33.401 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.402 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_PASSWORD": { 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "admin", 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.403 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-18T18:25:33.404 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.405 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_URL": { 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_URL", 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.406 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.407 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_USERNAME": { 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "admin", 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.408 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.409 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.410 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.411 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-18T18:25:33.412 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.413 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.414 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "PROMETHEUS_API_HOST": { 2024-03-18T18:25:33.415 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.416 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.417 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.418 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.419 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.420 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.421 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.422 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.423 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.424 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.425 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-18T18:25:33.426 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.427 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.428 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_ENABLED": { 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-18T18:25:33.429 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.430 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.431 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-18T18:25:33.432 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.433 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.434 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8", 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.435 INFO:teuthology.orchestra.run.smithi094.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "45", 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.436 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_ACCESS_KEY": { 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.437 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.438 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "admin", 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.439 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_SECRET_KEY": { 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-18T18:25:33.440 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.441 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_SSL_VERIFY": { 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.442 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "UNSAFE_TLS_v1_2": { 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-18T18:25:33.443 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.444 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.445 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.446 INFO:teuthology.orchestra.run.smithi094.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.447 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.448 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.449 INFO:teuthology.orchestra.run.smithi094.stdout: "cross_origin_url": { 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cross_origin_url", 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.450 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "crt_file": { 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crt_file", 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.451 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.452 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "debug": { 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "debug", 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.453 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Enable/disable debug options", 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.454 INFO:teuthology.orchestra.run.smithi094.stdout: "jwt_token_ttl": { 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "jwt_token_ttl", 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "28800", 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.455 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "key_file": { 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "key_file", 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.456 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.457 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.458 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.459 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.460 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.462 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.463 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.464 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.465 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "motd": { 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "motd", 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.466 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "The message of the day", 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "redirect_resolve_ip_addr": { 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "redirect_resolve_ip_addr", 2024-03-18T18:25:33.467 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.468 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "server_addr": { 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_addr", 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.469 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "::", 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.470 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "server_port": { 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_port", 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8080", 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.471 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "ssl": { 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssl", 2024-03-18T18:25:33.472 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.473 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "ssl_server_port": { 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssl_server_port", 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.474 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8443", 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.475 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_behaviour": { 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_behaviour", 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "redirect", 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.476 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "redirect" 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_error_status_code": { 2024-03-18T18:25:33.477 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_error_status_code", 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "500", 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "400", 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "599", 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.478 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "url_prefix": { 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "url_prefix", 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.479 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.480 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "devicehealth", 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: "enable_monitoring": { 2024-03-18T18:25:33.481 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enable_monitoring", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "monitor device health metrics", 2024-03-18T18:25:33.482 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.483 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.484 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.486 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.487 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.488 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.488 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.488 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.488 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.488 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.488 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.489 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.490 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.491 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "mark_out_threshold": { 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mark_out_threshold", 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "2419200", 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.492 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "pool_name": { 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pool_name", 2024-03-18T18:25:33.493 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "device_health_metrics", 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-18T18:25:33.494 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "retention_period": { 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "retention_period", 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.495 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "15552000", 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how long to retain device health metrics", 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.496 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "scrape_frequency": { 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "scrape_frequency", 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "86400", 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.497 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "self_heal": { 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "self_heal", 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.498 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.499 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.500 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to wake up and check device health", 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_threshold": { 2024-03-18T18:25:33.501 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_threshold", 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "7257600", 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.502 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "diskprediction_local", 2024-03-18T18:25:33.503 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.504 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.505 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.506 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.507 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.508 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.509 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.510 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.511 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "predict_interval": { 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "predict_interval", 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "86400", 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.512 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "predictor_model": { 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "predictor_model", 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.513 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "prophetstor", 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.514 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.515 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.516 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "influx", 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": false, 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "influxdb python module not found", 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "batch_size": { 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "batch_size", 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.517 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5000", 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.518 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "database": { 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "database", 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "ceph", 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.519 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": { 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "hostname", 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.520 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "InfluxDB server hostname", 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.521 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "30", 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "5", 2024-03-18T18:25:33.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.523 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.524 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.528 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.529 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.530 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "password": { 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "password", 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.531 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "password of InfluxDB server user", 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "port": { 2024-03-18T18:25:33.532 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "port", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8086", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "InfluxDB server port", 2024-03-18T18:25:33.533 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: "ssl": { 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssl", 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.534 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "false", 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.535 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "threads": { 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "threads", 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "32", 2024-03-18T18:25:33.536 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "username": { 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "username", 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.537 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "username of InfluxDB server user", 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.538 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "verify_ssl": { 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "verify_ssl", 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "true", 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.539 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.540 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "insights", 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.541 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "iostat", 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.554 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.555 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.556 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.557 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "localpool", 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "failure_domain": { 2024-03-18T18:25:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "failure_domain", 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "host", 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "failure domain for any created local pool", 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.562 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.563 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.564 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.565 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.566 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.567 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.567 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.567 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.567 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.567 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.568 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "min_size": { 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "min_size", 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.569 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "default min_size for any created local pool", 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "num_rep": { 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "num_rep", 2024-03-18T18:25:33.570 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "3", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "default replica count for any created local pool", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.571 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "pg_num": { 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pg_num", 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "128", 2024-03-18T18:25:33.572 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "default pg_num for any created local pool", 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.573 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "prefix": { 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "prefix", 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.574 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "name prefix for any created local pool", 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "subtree": { 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "subtree", 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.575 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "rack", 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.576 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mirroring", 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.577 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.578 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.579 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.580 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.581 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.582 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.583 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.584 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.585 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "nfs", 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.586 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.587 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.588 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.588 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.588 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.588 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.588 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.588 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.589 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.590 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.591 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.592 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.593 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.594 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "orchestrator", 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.595 INFO:teuthology.orchestra.run.smithi094.stdout: "fail_fs": { 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "fail_fs", 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.596 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.597 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.598 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.599 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.600 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.601 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.602 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.603 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.604 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "orchestrator": { 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "orchestrator", 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.605 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "cephadm", 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "rook", 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "test_orchestrator" 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Orchestrator backend", 2024-03-18T18:25:33.606 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "osd_perf_query", 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.607 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.608 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.609 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.610 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.611 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.612 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.613 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.614 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.615 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "osd_support", 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.616 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.617 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.618 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.619 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.620 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.621 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.622 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.623 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pg_autoscaler", 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.624 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.625 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.626 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.627 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.628 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.629 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.630 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.631 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.632 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.633 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "threshold": { 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "threshold", 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "3.0", 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1.0", 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.634 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "scaling threshold", 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.635 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "progress", 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "allow_pg_recovery_event": { 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "allow_pg_recovery_event", 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.636 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.637 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": { 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enabled", 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.638 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.639 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.640 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.641 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.642 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.643 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.644 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.645 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.646 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "max_completed_events": { 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_completed_events", 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.647 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "50", 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "number of past completed events to remember", 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:33.648 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how long the module is going to sleep", 2024-03-18T18:25:33.649 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "prometheus", 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.650 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "cache": { 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cache", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.651 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "exclude_perf_counters": { 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "exclude_perf_counters", 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.652 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.653 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.654 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.655 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.656 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.657 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.658 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.659 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.660 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.661 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_stats_pools": { 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_stats_pools", 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.662 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.663 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "300", 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.664 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "scrape_interval": { 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "scrape_interval", 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "15.0", 2024-03-18T18:25:33.665 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "server_addr": { 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_addr", 2024-03-18T18:25:33.666 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "::", 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-18T18:25:33.667 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "server_port": { 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_port", 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.668 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "9283", 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.669 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "stale_cache_strategy": { 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "stale_cache_strategy", 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "log", 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.670 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_behaviour": { 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_behaviour", 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.671 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "default", 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "default", 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "error" 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.672 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_error_status_code": { 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_error_status_code", 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.673 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "500", 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "400", 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "599", 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.674 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_support", 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.675 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.676 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.677 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.678 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.679 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.680 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.681 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.682 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "max_concurrent_snap_create": { 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_concurrent_snap_create", 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.683 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.684 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "mirror_snapshot_schedule": { 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mirror_snapshot_schedule", 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.685 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "trash_purge_schedule": { 2024-03-18T18:25:33.686 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "trash_purge_schedule", 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.687 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.688 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "restful", 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "enable_auth": { 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enable_auth", 2024-03-18T18:25:33.689 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.690 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "key_file": { 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "key_file", 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.691 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.692 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.693 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.694 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.695 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.696 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.697 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.698 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.699 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "server_addr": { 2024-03-18T18:25:33.700 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_addr", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.701 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "server_port": { 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_port", 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.702 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.703 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "selftest", 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.704 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.705 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.706 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.707 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.708 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.709 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.710 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.711 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "roption1": { 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "roption1", 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.712 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "roption2": { 2024-03-18T18:25:33.713 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "roption2", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "xyz", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.714 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption1": { 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption1", 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.715 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption2": { 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption2", 2024-03-18T18:25:33.716 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.717 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption3": { 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption3", 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.718 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.719 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption4": { 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption4", 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.720 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption5": { 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption5", 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.721 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.722 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption6": { 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption6", 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.723 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption7": { 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption7", 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.724 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "42", 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.725 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "testkey": { 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "testkey", 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.726 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "testlkey": { 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "testlkey", 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.727 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.728 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "testnewline": { 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "testnewline", 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.729 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.730 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "snap_schedule", 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "allow_m_granularity": { 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "allow_m_granularity", 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.731 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "allow minute scheduled snapshots", 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.732 INFO:teuthology.orchestra.run.smithi094.stdout: "dump_on_update": { 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "dump_on_update", 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.733 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "dump database to debug log on update", 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.734 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.735 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.736 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.737 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.738 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.739 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.740 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.741 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "stats", 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.742 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.743 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.744 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.745 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.746 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "status", 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.753 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.754 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.755 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.756 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.757 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.758 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "telegraf", 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.759 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "address": { 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "address", 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.760 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.761 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "15", 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.762 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.763 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.764 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.765 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.766 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.767 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.768 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.769 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.770 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "telemetry", 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_basic": { 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_basic", 2024-03-18T18:25:33.771 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.772 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_crash": { 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_crash", 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.773 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.774 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_device": { 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_device", 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.775 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_ident": { 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_ident", 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.776 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.777 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_perf": { 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_perf", 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.778 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "contact": { 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "contact", 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.779 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.780 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "description": { 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "description", 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.781 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "device_url": { 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "device_url", 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.782 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.783 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": { 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enabled", 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.784 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:33.785 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "24", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "8", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.786 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "last_opt_revision": { 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "last_opt_revision", 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.787 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "1", 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.788 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: "leaderboard": { 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "leaderboard", 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.789 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.790 INFO:teuthology.orchestra.run.smithi094.stdout: "leaderboard_description": { 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "leaderboard_description", 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.791 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.792 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.795 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.796 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.797 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.798 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.798 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.798 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.798 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.798 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.798 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.799 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "organization": { 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "organization", 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.800 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "proxy": { 2024-03-18T18:25:33.801 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "proxy", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.802 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "url": { 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "url", 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.803 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.804 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "test_orchestrator", 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.805 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.806 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.807 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.808 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.809 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.810 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.811 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.812 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "volumes", 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.813 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.814 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.815 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.816 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.817 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.818 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.819 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.820 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "max_concurrent_clones": { 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_concurrent_clones", 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.821 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "4", 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.822 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "snapshot_clone_delay": { 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "snapshot_clone_delay", 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.823 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "snapshot_clone_no_wait": { 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "snapshot_clone_no_wait", 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.824 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.825 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix", 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.826 INFO:teuthology.orchestra.run.smithi094.stdout: "discovery_interval": { 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "discovery_interval", 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "100", 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.827 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "identifier": { 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "identifier", 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.828 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.829 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.830 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.831 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.832 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.833 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.834 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.835 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.836 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.837 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.838 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "zabbix_host": { 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix_host", 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.839 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "zabbix_port": { 2024-03-18T18:25:33.840 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix_port", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10051", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.841 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "zabbix_sender": { 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix_sender", 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.842 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.843 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: "modules": [ 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: "iostat", 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: "nfs", 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: "restful" 2024-03-18T18:25:33.844 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "available_modules": [ 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "alerts", 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:33.845 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How frequently to reexamine health status", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.846 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.847 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.848 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.849 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.850 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.851 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.852 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.853 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.854 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_destination": { 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_destination", 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.855 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Email address to send alerts to", 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_from_name": { 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_from_name", 2024-03-18T18:25:33.856 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "Ceph", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Email From: name", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.857 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_host": { 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_host", 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.858 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SMTP server", 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_password": { 2024-03-18T18:25:33.859 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_password", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Password to authenticate with", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.860 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_port": { 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_port", 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "465", 2024-03-18T18:25:33.861 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SMTP port", 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_sender": { 2024-03-18T18:25:33.862 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_sender", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SMTP envelope sender", 2024-03-18T18:25:33.863 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_ssl": { 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_ssl", 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.864 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.865 INFO:teuthology.orchestra.run.smithi094.stdout: "smtp_user": { 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "smtp_user", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "User to authenticate as", 2024-03-18T18:25:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "balancer", 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "active": { 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "active", 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.868 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "automatically balance PGs across cluster", 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "begin_time": { 2024-03-18T18:25:33.869 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "begin_time", 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0000", 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "beginning time of day to automatically balance", 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "begin_weekday": { 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "begin_weekday", 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "0", 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "6", 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.872 INFO:teuthology.orchestra.run.smithi094.stdout: "crush_compat_max_iterations": { 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crush_compat_max_iterations", 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "25", 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "250", 2024-03-18T18:25:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "crush_compat_metrics": { 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crush_compat_metrics", 2024-03-18T18:25:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "pgs,objects,bytes", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-18T18:25:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "crush_compat_step": { 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crush_compat_step", 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0.5", 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "0.001", 2024-03-18T18:25:33.876 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "0.999", 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "aggressiveness of optimization", 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "end_time": { 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "end_time", 2024-03-18T18:25:33.877 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "2359", 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "ending time of day to automatically balance", 2024-03-18T18:25:33.878 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "end_weekday": { 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "end_weekday", 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.879 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "0", 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "6", 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.880 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.881 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.882 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.883 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.884 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.885 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.886 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.887 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.888 INFO:teuthology.orchestra.run.smithi094.stdout: "min_score": { 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "min_score", 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.889 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "mode": { 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mode", 2024-03-18T18:25:33.890 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "upmap", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "crush-compat", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "none", 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: "upmap" 2024-03-18T18:25:33.891 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Balancer mode", 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "pool_ids": { 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pool_ids", 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.892 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.893 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.894 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "upmap_max_deviation": { 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "upmap_max_deviation", 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.895 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.896 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "upmap_max_optimizations": { 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "upmap_max_optimizations", 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.897 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.898 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cephadm", 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "agent_down_multiplier": { 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "agent_down_multiplier", 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.899 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "3.0", 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.900 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "agent_refresh_rate": { 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "agent_refresh_rate", 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "20", 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.901 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "agent_starting_port": { 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "agent_starting_port", 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.902 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "4721", 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.903 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "allow_ptrace": { 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "allow_ptrace", 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.904 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "autotune_interval": { 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "autotune_interval", 2024-03-18T18:25:33.905 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.906 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "autotune_memory_target_ratio": { 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "autotune_memory_target_ratio", 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0.7", 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.907 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.908 INFO:teuthology.orchestra.run.smithi094.stdout: "cgroups_split": { 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cgroups_split", 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.909 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "config_checks_enabled": { 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "config_checks_enabled", 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.910 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.911 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "config_dashboard": { 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "config_dashboard", 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.912 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_alertmanager": { 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_alertmanager", 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.913 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.914 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_base": { 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_base", 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.915 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Container image name, without the tag", 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_elasticsearch": { 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_elasticsearch", 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.916 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "elasticsearch container image", 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.917 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_grafana": { 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_grafana", 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-03-18T18:25:33.918 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_haproxy": { 2024-03-18T18:25:33.919 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_haproxy", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "HAproxy container image", 2024-03-18T18:25:33.920 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_jaeger_agent": { 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_jaeger_agent", 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-18T18:25:33.921 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Jaeger agent container image", 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.922 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_jaeger_collector": { 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_jaeger_collector", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Jaeger collector container image", 2024-03-18T18:25:33.923 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_jaeger_query": { 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_jaeger_query", 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.924 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Jaeger query container image", 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.925 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_keepalived": { 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_keepalived", 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.926 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Keepalived container image", 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_loki": { 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_loki", 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.927 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Loki container image", 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.928 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_node_exporter": { 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_node_exporter", 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.929 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_nvmeof": { 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_nvmeof", 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.930 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Nvme-of container image", 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.931 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_prometheus": { 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_prometheus", 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.932 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Prometheus container image", 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_promtail": { 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_promtail", 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.933 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Promtail container image", 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.934 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "container_image_snmp_gateway": { 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_image_snmp_gateway", 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.935 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "SNMP Gateway container image", 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "container_init": { 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "container_init", 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.936 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Run podman/docker with `--init`", 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "daemon_cache_timeout": { 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "daemon_cache_timeout", 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "default_cephadm_command_timeout": { 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "default_cephadm_command_timeout", 2024-03-18T18:25:33.939 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "900", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.940 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "default_registry": { 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "default_registry", 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "docker.io", 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.941 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "device_cache_timeout": { 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "device_cache_timeout", 2024-03-18T18:25:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "1800", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "seconds to cache device inventory", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "device_enhanced_scan": { 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "device_enhanced_scan", 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.945 INFO:teuthology.orchestra.run.smithi094.stdout: "facts_cache_timeout": { 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "facts_cache_timeout", 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.946 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "seconds to cache host facts data", 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "host_check_interval": { 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "host_check_interval", 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.947 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to perform a host check", 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.948 INFO:teuthology.orchestra.run.smithi094.stdout: "hw_monitoring": { 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "hw_monitoring", 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.949 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "inventory_list_all": { 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "inventory_list_all", 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.950 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.951 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.952 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.953 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "log_refresh_metadata": { 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_refresh_metadata", 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.954 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.955 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.956 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-18T18:25:33.957 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.957 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.957 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.957 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.957 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.957 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.958 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.959 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.960 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.961 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.962 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "*", 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.963 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "max_count_per_host": { 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_count_per_host", 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.964 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "max number of daemons per service per host", 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.965 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "max_osd_draining_count": { 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_osd_draining_count", 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:33.966 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "migration_current": { 2024-03-18T18:25:33.967 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "migration_current", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "internal - do not modify", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.968 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "mode": { 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mode", 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "root", 2024-03-18T18:25:33.969 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: "cephadm-package", 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: "root" 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "mode for remote execution of cephadm", 2024-03-18T18:25:33.970 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "oob_default_addr": { 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "oob_default_addr", 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.971 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "169.254.1.1", 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.972 INFO:teuthology.orchestra.run.smithi094.stdout: "prometheus_alerts_path": { 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "prometheus_alerts_path", 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.973 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_insecure": { 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_insecure", 2024-03-18T18:25:33.974 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.975 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_password": { 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_password", 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.976 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_url": { 2024-03-18T18:25:33.977 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_url", 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.978 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "registry_username": { 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "registry_username", 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.979 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.980 INFO:teuthology.orchestra.run.smithi094.stdout: "secure_monitoring_stack": { 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "secure_monitoring_stack", 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.981 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "service_discovery_port": { 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "service_discovery_port", 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.982 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8765", 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "cephadm service discovery port", 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.983 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "ssh_config_file": { 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssh_config_file", 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.984 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "use_agent": { 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "use_agent", 2024-03-18T18:25:33.985 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-18T18:25:33.986 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "use_repo_digest": { 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "use_repo_digest", 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.987 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.988 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_on_failed_host_check": { 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_on_failed_host_check", 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.989 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise a health warning if the host check fails", 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.990 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_on_stray_daemons": { 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_on_stray_daemons", 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.991 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_on_stray_hosts": { 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_on_stray_hosts", 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:33.992 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.993 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crash", 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:33.994 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.995 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.996 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.997 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:33.998 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:33.999 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.000 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.001 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "retain_interval": { 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "retain_interval", 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.002 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "31536000", 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.003 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_recent_interval": { 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_recent_interval", 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "1209600", 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.004 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.005 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "dashboard", 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.006 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.007 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "ALERTMANAGER_API_HOST": { 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.008 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-18T18:25:34.009 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.010 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.011 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.011 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.011 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.011 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: "AUDIT_API_ENABLED": { 2024-03-18T18:25:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "AUDIT_API_ENABLED", 2024-03-18T18:25:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.015 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "ENABLE_BROWSABLE_API": { 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-18T18:25:34.017 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.018 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.019 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-18T18:25:34.020 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.021 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.022 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.023 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.024 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.025 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.026 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.027 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-18T18:25:34.028 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.029 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_PASSWORD": { 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.030 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "admin", 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-18T18:25:34.031 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.032 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_URL": { 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_URL", 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.033 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.034 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_API_USERNAME": { 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "admin", 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.035 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.036 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.037 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.038 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-18T18:25:34.039 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.040 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.041 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "PROMETHEUS_API_HOST": { 2024-03-18T18:25:34.042 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.043 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.044 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.045 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.046 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.047 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.048 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.049 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-18T18:25:34.050 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.051 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.052 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-18T18:25:34.053 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.054 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.055 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_ENABLED": { 2024-03-18T18:25:34.056 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.057 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.058 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.058 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.058 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.058 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-18T18:25:34.058 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-18T18:25:34.058 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.059 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.060 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.061 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8", 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.062 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "45", 2024-03-18T18:25:34.063 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_ACCESS_KEY": { 2024-03-18T18:25:34.064 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.065 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.066 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "admin", 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.067 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_SECRET_KEY": { 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.068 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "RGW_API_SSL_VERIFY": { 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.069 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.070 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: "UNSAFE_TLS_v1_2": { 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.071 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.072 INFO:teuthology.orchestra.run.smithi094.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.073 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.074 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.075 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.076 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "cross_origin_url": { 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cross_origin_url", 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.077 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.078 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "crt_file": { 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "crt_file", 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.079 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "debug": { 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "debug", 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.080 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Enable/disable debug options", 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.081 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "jwt_token_ttl": { 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "jwt_token_ttl", 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "28800", 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.082 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "key_file": { 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "key_file", 2024-03-18T18:25:34.083 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.084 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.085 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.086 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.087 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.088 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.089 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.090 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.091 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.092 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "motd": { 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "motd", 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.093 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "The message of the day", 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.094 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "redirect_resolve_ip_addr": { 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "redirect_resolve_ip_addr", 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.095 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "server_addr": { 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_addr", 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.096 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "::", 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.097 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "server_port": { 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_port", 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8080", 2024-03-18T18:25:34.098 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "ssl": { 2024-03-18T18:25:34.099 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssl", 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.100 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "ssl_server_port": { 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssl_server_port", 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.101 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8443", 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.102 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_behaviour": { 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_behaviour", 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "redirect", 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.103 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "redirect" 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.104 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_error_status_code": { 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_error_status_code", 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "500", 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "400", 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "599", 2024-03-18T18:25:34.105 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "url_prefix": { 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "url_prefix", 2024-03-18T18:25:34.106 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.107 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "devicehealth", 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.108 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "enable_monitoring": { 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enable_monitoring", 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.109 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "monitor device health metrics", 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.110 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.111 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.112 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.113 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.114 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.115 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.116 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.117 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "mark_out_threshold": { 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mark_out_threshold", 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.118 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "2419200", 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.119 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "pool_name": { 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pool_name", 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "device_health_metrics", 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.120 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "retention_period": { 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "retention_period", 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.121 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "15552000", 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how long to retain device health metrics", 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.122 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "scrape_frequency": { 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "scrape_frequency", 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "86400", 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.123 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "self_heal": { 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "self_heal", 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.124 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.125 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.126 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how frequently to wake up and check device health", 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "warn_threshold": { 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "warn_threshold", 2024-03-18T18:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "7257600", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.128 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "diskprediction_local", 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.129 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.130 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.131 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.132 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.133 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.134 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.135 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.136 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "predict_interval": { 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "predict_interval", 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.137 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "86400", 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.138 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "predictor_model": { 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "predictor_model", 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "prophetstor", 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.139 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.140 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "600", 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.141 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "influx", 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": false, 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "influxdb python module not found", 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "batch_size": { 2024-03-18T18:25:34.142 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "batch_size", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5000", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-18T18:25:34.143 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "database": { 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "database", 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.144 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "ceph", 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.145 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": { 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "hostname", 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.146 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "InfluxDB server hostname", 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.147 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "30", 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "5", 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.148 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.149 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.150 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.151 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.152 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.154 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.155 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "password": { 2024-03-18T18:25:34.156 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "password", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "password of InfluxDB server user", 2024-03-18T18:25:34.157 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "port": { 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "port", 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.158 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "8086", 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "InfluxDB server port", 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.159 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "ssl": { 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "ssl", 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "false", 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.160 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "threads": { 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "threads", 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.161 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "32", 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.162 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "username": { 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "username", 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.163 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "username of InfluxDB server user", 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "verify_ssl": { 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "verify_ssl", 2024-03-18T18:25:34.164 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "true", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.165 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "insights", 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.166 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.167 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.168 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.169 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.170 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.171 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.172 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.173 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.174 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "iostat", 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.175 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.176 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.177 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.178 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.179 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.180 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.181 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.183 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "localpool", 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "failure_domain": { 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "failure_domain", 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "host", 2024-03-18T18:25:34.184 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "failure domain for any created local pool", 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.185 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.186 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.187 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.188 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.189 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.190 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.191 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.192 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.193 INFO:teuthology.orchestra.run.smithi094.stdout: "min_size": { 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "min_size", 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.194 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "default min_size for any created local pool", 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "num_rep": { 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "num_rep", 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.195 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "3", 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "default replica count for any created local pool", 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.196 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "pg_num": { 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pg_num", 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "128", 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.197 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "default pg_num for any created local pool", 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "prefix": { 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "prefix", 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.198 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "name prefix for any created local pool", 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.199 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "subtree": { 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "subtree", 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "rack", 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.200 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.201 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mirroring", 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.202 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.203 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.204 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.205 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.206 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.207 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.208 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.209 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "nfs", 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.210 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.211 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.212 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.213 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.214 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.215 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.216 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.217 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "orchestrator", 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.218 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "fail_fs": { 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "fail_fs", 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.219 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.220 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.221 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.222 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.223 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.224 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.225 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.226 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.227 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "orchestrator": { 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "orchestrator", 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.228 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "cephadm", 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "rook", 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "test_orchestrator" 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Orchestrator backend", 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.229 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "osd_perf_query", 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.230 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.231 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.232 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.233 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.234 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.235 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.236 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.237 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.238 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "osd_support", 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.239 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.240 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.241 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.242 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.243 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.244 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.245 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.246 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "pg_autoscaler", 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.247 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.248 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.249 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.250 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.251 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.252 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.253 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.254 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:34.255 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.256 INFO:teuthology.orchestra.run.smithi094.stdout: "threshold": { 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "threshold", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "3.0", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1.0", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "scaling threshold", 2024-03-18T18:25:34.257 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "progress", 2024-03-18T18:25:34.258 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "allow_pg_recovery_event": { 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "allow_pg_recovery_event", 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.259 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.260 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": { 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enabled", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.261 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.262 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.263 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.264 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.265 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.266 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.267 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.268 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.269 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "max_completed_events": { 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_completed_events", 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "50", 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.270 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "number of past completed events to remember", 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "sleep_interval": { 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "sleep_interval", 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.271 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "5", 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "how long the module is going to sleep", 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.272 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "prometheus", 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.273 INFO:teuthology.orchestra.run.smithi094.stdout: "cache": { 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "cache", 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.274 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "exclude_perf_counters": { 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "exclude_perf_counters", 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.275 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.276 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.277 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.278 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.279 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.280 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.281 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.282 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.283 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_stats_pools": { 2024-03-18T18:25:34.284 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_stats_pools", 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.285 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.286 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "300", 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.287 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "scrape_interval": { 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "scrape_interval", 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.288 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "15.0", 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.289 INFO:teuthology.orchestra.run.smithi094.stdout: "server_addr": { 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_addr", 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "::", 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.290 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.291 INFO:teuthology.orchestra.run.smithi094.stdout: "server_port": { 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_port", 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "9283", 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.292 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "stale_cache_strategy": { 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "stale_cache_strategy", 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.293 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "log", 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.294 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_behaviour": { 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_behaviour", 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "default", 2024-03-18T18:25:34.295 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "default", 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "error" 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.296 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "standby_error_status_code": { 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "standby_error_status_code", 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "500", 2024-03-18T18:25:34.297 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "400", 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "599", 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.298 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_support", 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.299 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.300 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.301 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.302 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.303 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.304 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.305 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.306 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.307 INFO:teuthology.orchestra.run.smithi094.stdout: "max_concurrent_snap_create": { 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_concurrent_snap_create", 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10", 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.308 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "mirror_snapshot_schedule": { 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "mirror_snapshot_schedule", 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.309 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.310 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "trash_purge_schedule": { 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "trash_purge_schedule", 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.311 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.312 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "restful", 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "enable_auth": { 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enable_auth", 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.313 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.314 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "key_file": { 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "key_file", 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.315 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.316 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.317 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.318 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.319 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.320 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.321 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.322 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.323 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "server_addr": { 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_addr", 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.324 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.325 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "server_port": { 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "server_port", 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.326 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.327 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "selftest", 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.328 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.329 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.330 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.331 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.333 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.333 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.333 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.333 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.334 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.335 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.336 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.337 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "roption1": { 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "roption1", 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.338 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "roption2": { 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "roption2", 2024-03-18T18:25:34.339 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "xyz", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.340 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption1": { 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption1", 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.341 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption2": { 2024-03-18T18:25:34.342 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption2", 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.343 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption3": { 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption3", 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "float", 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.344 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.345 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption4": { 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption4", 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.346 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption5": { 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption5", 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.347 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.348 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption6": { 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption6", 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.349 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "rwoption7": { 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rwoption7", 2024-03-18T18:25:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "1", 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "42", 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: "testkey": { 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "testkey", 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: "testlkey": { 2024-03-18T18:25:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "testlkey", 2024-03-18T18:25:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "testnewline": { 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "testnewline", 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "snap_schedule", 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: "allow_m_granularity": { 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "allow_m_granularity", 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "allow minute scheduled snapshots", 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "dump_on_update": { 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "dump_on_update", 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "dump database to debug log on update", 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.363 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.364 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.365 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.366 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.367 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.368 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.369 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "stats", 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.370 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.371 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.372 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.373 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.374 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.375 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.376 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.377 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.378 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "status", 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.379 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.380 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.381 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.382 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.383 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.384 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.385 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.386 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "telegraf", 2024-03-18T18:25:34.387 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "address": { 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "address", 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-18T18:25:34.388 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:34.389 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "15", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.390 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.391 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.392 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.393 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.394 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.395 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.396 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.397 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.398 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.399 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "telemetry", 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_basic": { 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_basic", 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.400 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.401 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_crash": { 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_crash", 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.402 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_device": { 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_device", 2024-03-18T18:25:34.403 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-18T18:25:34.404 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_ident": { 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_ident", 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.405 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.406 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "channel_perf": { 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "channel_perf", 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.407 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "contact": { 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "contact", 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.408 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.409 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "description": { 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "description", 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.410 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.411 INFO:teuthology.orchestra.run.smithi094.stdout: "device_url": { 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "device_url", 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.412 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": { 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "enabled", 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.413 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.414 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.415 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "24", 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "8", 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.416 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "last_opt_revision": { 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "last_opt_revision", 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "1", 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.417 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "leaderboard": { 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "leaderboard", 2024-03-18T18:25:34.418 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.419 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "leaderboard_description": { 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "leaderboard_description", 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.420 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.421 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.422 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.423 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.424 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.425 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.426 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.427 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.428 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.429 INFO:teuthology.orchestra.run.smithi094.stdout: "organization": { 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "organization", 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.430 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "proxy": { 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "proxy", 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.431 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.432 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "url": { 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "url", 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-18T18:25:34.433 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.434 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "test_orchestrator", 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.435 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.436 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.437 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.438 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.439 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.440 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.441 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.442 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.443 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "volumes", 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.444 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.445 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.446 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.447 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.448 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.449 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.450 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.451 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "max_concurrent_clones": { 2024-03-18T18:25:34.452 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "max_concurrent_clones", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "4", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-18T18:25:34.453 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "snapshot_clone_delay": { 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "snapshot_clone_delay", 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.454 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "0", 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.455 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "snapshot_clone_no_wait": { 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "snapshot_clone_no_wait", 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "True", 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.456 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.457 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix", 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "can_run": true, 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "error_string": "", 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "module_options": { 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "discovery_interval": { 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "discovery_interval", 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "uint", 2024-03-18T18:25:34.458 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "100", 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.459 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "identifier": { 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "identifier", 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.460 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "interval": { 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "interval", 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "secs", 2024-03-18T18:25:34.461 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "60", 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.462 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "log_level": { 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_level", 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.463 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.464 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster": { 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster", 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.465 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.466 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_cluster_level": { 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_cluster_level", 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "info", 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.467 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [ 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "critical", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "debug", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "error", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "info", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "warning" 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.468 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "log_to_file": { 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "log_to_file", 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "bool", 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.469 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 1, 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "False", 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.470 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "zabbix_host": { 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix_host", 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "", 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.471 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "zabbix_port": { 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix_port", 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "int", 2024-03-18T18:25:34.472 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "10051", 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.473 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "zabbix_sender": { 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zabbix_sender", 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "str", 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "level": "advanced", 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "flags": 0, 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "min": "", 2024-03-18T18:25:34.474 INFO:teuthology.orchestra.run.smithi094.stdout: "max": "", 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: "enum_allowed": [], 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: "desc": "", 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: "long_desc": "", 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: "see_also": [] 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.475 INFO:teuthology.orchestra.run.smithi094.stdout: "services": {}, 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "always_on_modules": { 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "octopus": [ 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "balancer", 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "crash", 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "devicehealth", 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "orchestrator", 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "pg_autoscaler", 2024-03-18T18:25:34.476 INFO:teuthology.orchestra.run.smithi094.stdout: "progress", 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_support", 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "status", 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "telemetry", 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "volumes" 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "pacific": [ 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "balancer", 2024-03-18T18:25:34.477 INFO:teuthology.orchestra.run.smithi094.stdout: "crash", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "devicehealth", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "orchestrator", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "pg_autoscaler", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "progress", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_support", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "status", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "telemetry", 2024-03-18T18:25:34.478 INFO:teuthology.orchestra.run.smithi094.stdout: "volumes" 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: "quincy": [ 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: "balancer", 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: "crash", 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: "devicehealth", 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: "orchestrator", 2024-03-18T18:25:34.479 INFO:teuthology.orchestra.run.smithi094.stdout: "pg_autoscaler", 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "progress", 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_support", 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "status", 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "telemetry", 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "volumes" 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "reef": [ 2024-03-18T18:25:34.480 INFO:teuthology.orchestra.run.smithi094.stdout: "balancer", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "crash", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "devicehealth", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "orchestrator", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "pg_autoscaler", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "progress", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "rbd_support", 2024-03-18T18:25:34.481 INFO:teuthology.orchestra.run.smithi094.stdout: "status", 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: "telemetry", 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: "volumes" 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: "last_failure_osd_epoch": 0, 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: "active_clients": [ 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.482 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "devicehealth", 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: "addrvec": [ 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v2", 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:0", 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 773740730 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.483 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "libcephsqlite", 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: "addrvec": [ 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v2", 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:0", 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 379347233 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:34.484 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "rbd_support", 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: "addrvec": [ 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v2", 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:0", 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 904561310 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:34.485 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "volumes", 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: "addrvec": [ 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v2", 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:0", 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 2112164257 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.486 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:34.487 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.487 INFO:teuthology.orchestra.run.smithi094.stdout: ] 2024-03-18T18:25:34.487 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:34.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02bc066730 msgr2=0x7f02bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02bc066730 0x7f02bc068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009ad0 tx=0x7f02cc009240 comp rx=0 tx=0).stop 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 msgr2=0x7f02d813f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 0x7f02d813f940 secure :-1 s=READY pgs=4481 cs=0 l=1 rev1=1 crypto rx=0x7f02d000e7f0 tx=0x7f02d000eb00 comp rx=0 tx=0).stop 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 shutdown_connections 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f02bc066730 0x7f02bc068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f02d80bb6b0 0x7f02d813f940 unknown :-1 s=CLOSED pgs=4481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02d80b8270 0x7f02d813f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:34.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 --2- 172.21.15.94:0/3077587951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02d809ac60 0x7f02d809c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:34.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 >> 172.21.15.94:0/3077587951 conn(0x7f02d809dbf0 msgr2=0x7f02d80b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:34.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 shutdown_connections 2024-03-18T18:25:34.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:33.211+0000 7f02de960700 1 -- 172.21.15.94:0/3077587951 wait complete. 2024-03-18T18:25:34.526 DEBUG:tasks.check_counter:Getting stats from a 2024-03-18T18:25:34.526 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-03-18T18:25:34.639 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-0": { 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 4, 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 4, 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 1568, 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 448, 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 4, 2024-03-18T18:25:34.640 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 0, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.002584722, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.000064912, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.001176029, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 3, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.001639912, 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000546637 2024-03-18T18:25:34.641 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 448 2024-03-18T18:25:34.642 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-1": { 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 2, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 202, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 320, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 187779, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 4, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 2, 2024-03-18T18:25:34.643 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.022932291, 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.016930954, 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.003274714, 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 201, 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.012860141, 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000063980 2024-03-18T18:25:34.644 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 187648 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.645 INFO:teuthology.orchestra.run.smithi094.stdout: "AsyncMessenger::Worker-2": { 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_messages": 266, 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages": 264, 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_bytes": 162827, 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_bytes": 150960, 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_created_connections": 2, 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_active_connections": 1, 2024-03-18T18:25:34.646 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_total_time": 0.056281578, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_send_time": 0.023583742, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_recv_time": 0.017046159, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_running_fast_dispatch_time": 0.010944005, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_messages_queue_lat": { 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 264, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.014077282, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000053323 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.647 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_handle_ack_lat": { 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_recv_encrypted_bytes": 162720, 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: "msgr_send_encrypted_bytes": 150688 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.648 INFO:teuthology.orchestra.run.smithi094.stdout: "cct": { 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "total_workers": 0, 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "unhealthy_workers": 0 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "mempool": { 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_bytes": 0, 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bloom_filter_items": 0, 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_bytes": 0, 2024-03-18T18:25:34.649 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_alloc_items": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_bytes": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_data_items": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_onode_items": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_meta_items": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_bytes": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_other_items": 0, 2024-03-18T18:25:34.650 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_cache_buffer_items": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_bytes": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_extent_items": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_bytes": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_blob_items": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_shared_blob_items": 0, 2024-03-18T18:25:34.651 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_inline_bl_items": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_bytes": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_fsck_items": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_bytes": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_txc_items": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_deferred_items": 0, 2024-03-18T18:25:34.652 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_bytes": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluestore_writing_items": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_bytes": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_items": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_bytes": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_reader_items": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_bytes": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "bluefs_file_writer_items": 0, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_bytes": 147920, 2024-03-18T18:25:34.653 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_anon_items": 27, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_bytes": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "buffer_meta_items": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_bytes": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_items": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_bytes": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_mapbl_items": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_bytes": 0, 2024-03-18T18:25:34.654 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_pglog_items": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_bytes": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_items": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_bytes": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "osdmap_mapping_items": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_bytes": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "pgmap_items": 0, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_bytes": 928, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_co_items": 2, 2024-03-18T18:25:34.655 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_bytes": 0, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_1_items": 0, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_bytes": 0, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "unittest_2_items": 0 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "val": 0, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "max": 104857600, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "get_started": 0, 2024-03-18T18:25:34.656 INFO:teuthology.orchestra.run.smithi094.stdout: "get": 267, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "get_sum": 125252, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_fail": 0, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "get_or_fail_success": 267, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "take": 0, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "take_sum": 0, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "put": 267, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "put_sum": 125252, 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "wait": { 2024-03-18T18:25:34.657 INFO:teuthology.orchestra.run.smithi094.stdout: "avgcount": 0, 2024-03-18T18:25:34.658 INFO:teuthology.orchestra.run.smithi094.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.658 INFO:teuthology.orchestra.run.smithi094.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.658 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.658 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-03-18T18:25:34.658 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:34.659 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-03-18T18:25:34.659 DEBUG:tasks.check_counter:Getting stats from b 2024-03-18T18:25:34.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-03-18T18:25:34.786 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-03-18T18:25:34.787 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-03-18T18:25:34.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 89073, 2024-03-18T18:25:34.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 107189, 2024-03-18T18:25:34.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 28059966, 2024-03-18T18:25:34.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 274995871, 2024-03-18T18:25:34.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 698, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 10.891556758, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 4.169118624, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 3.905331923, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 2.331495240, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 107188, 2024-03-18T18:25:34.788 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 31.091487215, 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000290064 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 71616, 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.023754051, 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000331 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-18T18:25:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 302465, 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 390423, 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 91732581, 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 334153749, 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 1001, 2024-03-18T18:25:34.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 35.795304751, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 15.911633622, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 22.636848016, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.653948535, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 390422, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 50.636333520, 2024-03-18T18:25:34.791 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000129696 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 585804, 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.183174489, 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000312 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1888, 2024-03-18T18:25:34.792 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 519552 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 81110, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 79972, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 20550135, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 320701599, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 627, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-03-18T18:25:34.793 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 9.597307630, 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 3.464281218, 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 2.062704521, 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 3.150257017, 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 79971, 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 50.247389963, 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000628320 2024-03-18T18:25:34.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6226, 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001950274, 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000313 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 205024, 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 170624 2024-03-18T18:25:34.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 159971, 2024-03-18T18:25:34.796 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 114.441438222, 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000715388 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 26719, 2024-03-18T18:25:34.797 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 12.888255158, 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000482362 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 129577, 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 129577, 2024-03-18T18:25:34.798 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 129577, 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 254.593982454, 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001964808 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-03-18T18:25:34.799 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 2438, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 164, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 254, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 54, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 200, 2024-03-18T18:25:34.800 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 176, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 2, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 157487, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 156758, 2024-03-18T18:25:34.801 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 8, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-03-18T18:25:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 1016, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 147, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 16904814, 2024-03-18T18:25:34.803 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 4, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-03-18T18:25:34.804 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 46311, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 100895, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 8, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 1, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 142122, 2024-03-18T18:25:34.805 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 47541, 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 206, 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 105180 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-03-18T18:25:34.806 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 0, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 6, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 32621, 2024-03-18T18:25:34.807 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 32613, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 3, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-03-18T18:25:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 164, 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-03-18T18:25:34.809 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 224366, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 136356, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 136356, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 88010, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 1024, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 312, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 184, 2024-03-18T18:25:34.810 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 184, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 129, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 1, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 388943398, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 647165480, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-03-18T18:25:34.811 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 79651, 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 314.672709048, 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.003950643 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 206, 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 73192, 2024-03-18T18:25:34.812 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 72986, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 44, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 1610, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1566, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 254, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 105785, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 105531, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-03-18T18:25:34.813 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 38914, 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 38914, 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 145580, 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 207224 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 161940, 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-03-18T18:25:34.814 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 129577, 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 35749, 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 32484, 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 47.043131552, 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001448193 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.815 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3273, 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 17.457241329, 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.005333712 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 7, 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001789823, 2024-03-18T18:25:34.816 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000255689 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6, 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.013223197, 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002203866 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-03-18T18:25:34.817 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 24463, 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 13.306885822, 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000543959 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 520, 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.819032282, 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001575062 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.819 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.820 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.820 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-03-18T18:25:34.820 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4, 2024-03-18T18:25:34.820 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000335612, 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000083903 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 223, 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.067710991, 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000303636 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.821 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 299, 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.837981997, 2024-03-18T18:25:34.822 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002802615 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-03-18T18:25:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 34, 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.621568320, 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.018281421 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 15124, 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 19.883943582, 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001314727 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.824 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2321, 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 29.757736622, 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.012821084 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 14, 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.048274751, 2024-03-18T18:25:34.825 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.003448196 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.020350382, 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.010175191 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.826 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1083, 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.765649598, 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001630332 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 272, 2024-03-18T18:25:34.827 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3.707547433, 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.013630689 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 30, 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.354392835, 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.011813094 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.828 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 56, 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.071297504, 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001273169 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 16762, 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 59.447291639, 2024-03-18T18:25:34.829 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.003546551 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-03-18T18:25:34.830 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 120, 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.213011397, 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001775094 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 76, 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.118810591, 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001563297 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 26, 2024-03-18T18:25:34.832 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.027900862, 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001073110 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 32370, 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 59.007439936, 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001822905 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.833 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8, 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001434397, 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000179299 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.835 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-03-18T18:25:34.835 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 0, 2024-03-18T18:25:34.835 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2306, 2024-03-18T18:25:34.835 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2306, 2024-03-18T18:25:34.835 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 0, 2024-03-18T18:25:34.835 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-03-18T18:25:34.836 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 12702, 2024-03-18T18:25:34.836 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 12702, 2024-03-18T18:25:34.836 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 0, 2024-03-18T18:25:34.836 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-03-18T18:25:34.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.837 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-03-18T18:25:34.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-03-18T18:25:34.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-03-18T18:25:34.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-03-18T18:25:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-03-18T18:25:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-03-18T18:25:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-03-18T18:25:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-18T18:25:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-03-18T18:25:34.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-18T18:25:34.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-03-18T18:25:34.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-03-18T18:25:34.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-03-18T18:25:34.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-18T18:25:34.840 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-03-18T18:25:34.840 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-03-18T18:25:34.840 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-03-18T18:25:34.840 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-03-18T18:25:34.840 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-03-18T18:25:34.840 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-03-18T18:25:34.841 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-03-18T18:25:34.842 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 480985, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 159, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-03-18T18:25:34.843 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 5904, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 87, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-03-18T18:25:34.844 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 776848, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 9271, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-03-18T18:25:34.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 162142, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 683272380, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 37, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 162142, 2024-03-18T18:25:34.846 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 162142, 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3695.927350433, 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.022794386 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 162142, 2024-03-18T18:25:34.847 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 176441 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 162142, 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 1556, 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 160586, 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-03-18T18:25:34.848 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 1035, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 4740, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 540, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 80191, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 345, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-03-18T18:25:34.849 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 4, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 72681, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 1016, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 9489, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-03-18T18:25:34.850 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-03-18T18:25:34.851 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 6, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-03-18T18:25:34.852 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-03-18T18:25:34.853 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 55, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 34, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 8, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 8, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-03-18T18:25:34.854 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 5167, 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 1227 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-03-18T18:25:34.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 129741 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 544, 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-03-18T18:25:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 32, 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 32613, 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-03-18T18:25:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 472643, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 97785195, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 472643, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 472643, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 97785195, 2024-03-18T18:25:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-03-18T18:25:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-03-18T18:25:34.860 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-03-18T18:25:34.860 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-03-18T18:25:34.860 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-03-18T18:25:34.860 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-03-18T18:25:34.860 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-03-18T18:25:34.861 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 162142, 2024-03-18T18:25:34.861 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 686958821, 2024-03-18T18:25:34.861 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 162142, 2024-03-18T18:25:34.861 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 686958821, 2024-03-18T18:25:34.861 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-03-18T18:25:34.862 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.862 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.862 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.862 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-03-18T18:25:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-03-18T18:25:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-03-18T18:25:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-03-18T18:25:34.863 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-03-18T18:25:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-03-18T18:25:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-03-18T18:25:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-03-18T18:25:34.864 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 162142, 2024-03-18T18:25:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 162142, 2024-03-18T18:25:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 162142, 2024-03-18T18:25:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 162142, 2024-03-18T18:25:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-03-18T18:25:34.865 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-03-18T18:25:34.866 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 32613, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 3686441, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 32613, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 540, 2024-03-18T18:25:34.867 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3686441, 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x55ebd043ad20": { 2024-03-18T18:25:34.868 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 8386, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 224366, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 642971176, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 224366, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-03-18T18:25:34.869 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 79651, 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 642962790, 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.870 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-03-18T18:25:34.871 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-03-18T18:25:34.872 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=164 2024-03-18T18:25:34.872 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-18T18:25:34.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T18:25:34.882 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:25:35.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 Processor -- start 2024-03-18T18:25:35.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 -- start start 2024-03-18T18:25:35.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71c409ac60 0x7f71c40b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c41403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40b9be0 con 0x7f71c40bb6b0 2024-03-18T18:25:35.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40ba110 con 0x7f71c409ac60 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71ca254700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c409b040 con 0x7f71c40b8270 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71c409ac60 0x7f71c40b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71c409ac60 0x7f71c40b87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54638/0 (socket says 172.21.15.94:54638) 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 -- 172.21.15.94:0/2869503988 learned_addr learned my addr 172.21.15.94:0/2869503988 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c8a51700 1 --2- 172.21.15.94:0/2869503988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c41403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 -- 172.21.15.94:0/2869503988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 msgr2=0x7f71c41403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 --2- 172.21.15.94:0/2869503988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c41403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 -- 172.21.15.94:0/2869503988 >> v1:172.21.15.151:6789/0 conn(0x7f71c40bb6b0 legacy=0x7f71c406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 -- 172.21.15.94:0/2869503988 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40b9e30 con 0x7f71c409ac60 2024-03-18T18:25:35.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71c9252700 1 --2- 172.21.15.94:0/2869503988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c409ac60 0x7f71c40b87c0 secure :-1 s=READY pgs=4482 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009910 tx=0x7f71b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d5f7cd85ab2138 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71bbfff700 1 -- 172.21.15.94:0/2869503988 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4011830 con 0x7f71c409ac60 2024-03-18T18:25:35.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71bbfff700 1 -- 172.21.15.94:0/2869503988 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4011990 con 0x7f71c409ac60 2024-03-18T18:25:35.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:34.999+0000 7f71bbfff700 1 -- 172.21.15.94:0/2869503988 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4011d40 con 0x7f71c409ac60 2024-03-18T18:25:35.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 -- 172.21.15.94:0/2869503988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c409ac60 msgr2=0x7f71c40b87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 --2- 172.21.15.94:0/2869503988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c409ac60 0x7f71c40b87c0 secure :-1 s=READY pgs=4482 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009910 tx=0x7f71b4009c20 comp rx=0 tx=0).stop 2024-03-18T18:25:35.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 -- 172.21.15.94:0/2869503988 shutdown_connections 2024-03-18T18:25:35.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 --2- 172.21.15.94:0/2869503988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c41403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 --2- 172.21.15.94:0/2869503988 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c409ac60 0x7f71c40b87c0 unknown :-1 s=CLOSED pgs=4482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 -- 172.21.15.94:0/2869503988 >> 172.21.15.94:0/2869503988 conn(0x7f71c409dbf0 msgr2=0x7f71c409dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:35.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 -- 172.21.15.94:0/2869503988 shutdown_connections 2024-03-18T18:25:35.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 -- 172.21.15.94:0/2869503988 wait complete. 2024-03-18T18:25:35.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 Processor -- start 2024-03-18T18:25:35.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.003+0000 7f71ca254700 1 -- start start 2024-03-18T18:25:35.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c409ac60 0x7f71c40b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c40b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 0x7f71c414a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b6290 con 0x7f71c40bb6b0 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b39e0 con 0x7f71c409ac60 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c414ab30 con 0x7f71c40b8270 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 0x7f71c414a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 0x7f71c414a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54652/0 (socket says 172.21.15.94:54652) 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 -- 172.21.15.94:0/2321460363 learned_addr learned my addr 172.21.15.94:0/2321460363 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:35.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9252700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c409ac60 0x7f71c40b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c8a51700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c40b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 -- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 msgr2=0x7f71c40b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c40b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 -- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c409ac60 msgr2=0x7f71c40b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c409ac60 0x7f71c40b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 -- 172.21.15.94:0/2321460363 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4009570 con 0x7f71c40bb6b0 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71c9a53700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 0x7f71c414a5f0 secure :-1 s=READY pgs=4483 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c460 tx=0x7f71bc00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0052d0 con 0x7f71c40bb6b0 2024-03-18T18:25:35.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc005430 con 0x7f71c40bb6b0 2024-03-18T18:25:35.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40b45b0 con 0x7f71c40bb6b0 2024-03-18T18:25:35.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0055a0 con 0x7f71c40bb6b0 2024-03-18T18:25:35.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c4149850 con 0x7f71c40bb6b0 2024-03-18T18:25:35.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4067620 con 0x7f71c40bb6b0 2024-03-18T18:25:35.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.007+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f71bc0038e0 con 0x7f71c40bb6b0 2024-03-18T18:25:35.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.011+0000 7f71b9ffb700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f71a8066760 0x7f71a8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.011+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f71bc0834c0 con 0x7f71c40bb6b0 2024-03-18T18:25:35.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.011+0000 7f71c9252700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f71a8066760 0x7f71a8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.011+0000 7f71c9252700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f71a8066760 0x7f71a8068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000c00 tx=0x7f71b4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.015+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f71bc050780 con 0x7f71c40bb6b0 2024-03-18T18:25:35.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.179+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71c40bc480 con 0x7f71a8066760 2024-03-18T18:25:35.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.187+0000 7f71b9ffb700 1 -- 172.21.15.94:0/2321460363 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293057 (secure 0 0 0) 0x7f71c40bc480 con 0x7f71a8066760 2024-03-18T18:25:35.193 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:35.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f71a8066760 msgr2=0x7f71a8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f71a8066760 0x7f71a8068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000c00 tx=0x7f71b4008030 comp rx=0 tx=0).stop 2024-03-18T18:25:35.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 msgr2=0x7f71c414a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 0x7f71c414a5f0 secure :-1 s=READY pgs=4483 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c460 tx=0x7f71bc00c770 comp rx=0 tx=0).stop 2024-03-18T18:25:35.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 shutdown_connections 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f71a8066760 0x7f71a8068c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71c40bb6b0 0x7f71c414a5f0 unknown :-1 s=CLOSED pgs=4483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71c40b8270 0x7f71c40b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 --2- 172.21.15.94:0/2321460363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c409ac60 0x7f71c40b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 >> 172.21.15.94:0/2321460363 conn(0x7f71c409dbf0 msgr2=0x7f71c40bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 shutdown_connections 2024-03-18T18:25:35.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.191+0000 7f71ca254700 1 -- 172.21.15.94:0/2321460363 wait complete. 2024-03-18T18:25:35.197 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:25:35.207 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-03-18T18:25:34.913637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264878012,"num_objects":229,"num_object_clones":28,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":13,"num_read":1722,"num_read_kb":4075,"num_write":163763,"num_write_kb":737620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327039,"ondisk_log_size":327039,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2961284,"kb_used_data":522228,"kb_used_omap":12,"kb_used_meta":2438963,"kb_avail":752013436,"statfs":{"total":773094113280,"available":770061758464,"internally_reserved":0,"allocated":534761472,"data_stored":531864134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2497498684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1118810,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":6,"num_read_kb":7,"num_write":92,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.922055"},"pg_stats":[{"pgid":"3.3f","version":"54'3531","reported_seq":2937,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629972+0000","last_change":"2024-03-18T18:25:29.057112+0000","last_active":"2024-03-18T18:25:30.629972+0000","last_peered":"2024-03-18T18:25:30.629972+0000","last_clean":"2024-03-18T18:25:30.629972+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:25:30.629972+0000","last_undegraded":"2024-03-18T18:25:30.629972+0000","last_fullsized":"2024-03-18T18:25:30.629972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3531,"log_dups_size":0,"ondisk_log_size":3531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3e","version":"54'3322","reported_seq":2747,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746698+0000","last_change":"2024-03-18T18:25:29.045338+0000","last_active":"2024-03-18T18:25:32.746698+0000","last_peered":"2024-03-18T18:25:32.746698+0000","last_clean":"2024-03-18T18:25:32.746698+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:25:32.746698+0000","last_undegraded":"2024-03-18T18:25:32.746698+0000","last_fullsized":"2024-03-18T18:25:32.746698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.3d","version":"54'3570","reported_seq":2978,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798788+0000","last_change":"2024-03-18T18:25:29.051316+0000","last_active":"2024-03-18T18:25:32.798788+0000","last_peered":"2024-03-18T18:25:32.798788+0000","last_clean":"2024-03-18T18:25:32.798788+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:32.798788+0000","last_undegraded":"2024-03-18T18:25:32.798788+0000","last_fullsized":"2024-03-18T18:25:32.798788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.3c","version":"54'3829","reported_seq":3135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.703386+0000","last_change":"2024-03-18T18:25:29.029488+0000","last_active":"2024-03-18T18:25:30.703386+0000","last_peered":"2024-03-18T18:25:30.703386+0000","last_clean":"2024-03-18T18:25:30.703386+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:25:30.703386+0000","last_undegraded":"2024-03-18T18:25:30.703386+0000","last_fullsized":"2024-03-18T18:25:30.703386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3b","version":"54'3564","reported_seq":2926,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.625944+0000","last_change":"2024-03-18T18:25:29.053880+0000","last_active":"2024-03-18T18:25:30.625944+0000","last_peered":"2024-03-18T18:25:30.625944+0000","last_clean":"2024-03-18T18:25:30.625944+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:25:30.625944+0000","last_undegraded":"2024-03-18T18:25:30.625944+0000","last_fullsized":"2024-03-18T18:25:30.625944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3a","version":"54'3681","reported_seq":3009,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986656+0000","last_change":"2024-03-18T18:25:29.226526+0000","last_active":"2024-03-18T18:25:32.986656+0000","last_peered":"2024-03-18T18:25:32.986656+0000","last_clean":"2024-03-18T18:25:32.986656+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:25:32.986656+0000","last_undegraded":"2024-03-18T18:25:32.986656+0000","last_fullsized":"2024-03-18T18:25:32.986656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:13:50.287435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.39","version":"54'3918","reported_seq":3239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.673256+0000","last_change":"2024-03-18T18:25:29.050955+0000","last_active":"2024-03-18T18:25:30.673256+0000","last_peered":"2024-03-18T18:25:30.673256+0000","last_clean":"2024-03-18T18:25:30.673256+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:25:30.673256+0000","last_undegraded":"2024-03-18T18:25:30.673256+0000","last_fullsized":"2024-03-18T18:25:30.673256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3918,"log_dups_size":0,"ondisk_log_size":3918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.38","version":"54'3528","reported_seq":2938,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986528+0000","last_change":"2024-03-18T18:25:29.224146+0000","last_active":"2024-03-18T18:25:32.986528+0000","last_peered":"2024-03-18T18:25:32.986528+0000","last_clean":"2024-03-18T18:25:32.986528+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:25:32.986528+0000","last_undegraded":"2024-03-18T18:25:32.986528+0000","last_fullsized":"2024-03-18T18:25:32.986528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:28:08.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.37","version":"54'3888","reported_seq":3242,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.666631+0000","last_change":"2024-03-18T18:25:29.056418+0000","last_active":"2024-03-18T18:25:30.666631+0000","last_peered":"2024-03-18T18:25:30.666631+0000","last_clean":"2024-03-18T18:25:30.666631+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:25:30.666631+0000","last_undegraded":"2024-03-18T18:25:30.666631+0000","last_fullsized":"2024-03-18T18:25:30.666631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.36","version":"54'3823","reported_seq":3237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.476053+0000","last_change":"2024-03-18T18:25:29.022953+0000","last_active":"2024-03-18T18:25:30.476053+0000","last_peered":"2024-03-18T18:25:30.476053+0000","last_clean":"2024-03-18T18:25:30.476053+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:25:30.476053+0000","last_undegraded":"2024-03-18T18:25:30.476053+0000","last_fullsized":"2024-03-18T18:25:30.476053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3823,"log_dups_size":0,"ondisk_log_size":3823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.35","version":"54'3532","reported_seq":2954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.445010+0000","last_change":"2024-03-18T18:25:29.017560+0000","last_active":"2024-03-18T18:25:30.445010+0000","last_peered":"2024-03-18T18:25:30.445010+0000","last_clean":"2024-03-18T18:25:30.445010+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:25:30.445010+0000","last_undegraded":"2024-03-18T18:25:30.445010+0000","last_fullsized":"2024-03-18T18:25:30.445010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.34","version":"54'4119","reported_seq":3410,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.503175+0000","last_change":"2024-03-18T18:25:29.195788+0000","last_active":"2024-03-18T18:25:30.503175+0000","last_peered":"2024-03-18T18:25:30.503175+0000","last_clean":"2024-03-18T18:25:30.503175+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:30.503175+0000","last_undegraded":"2024-03-18T18:25:30.503175+0000","last_fullsized":"2024-03-18T18:25:30.503175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.33","version":"54'3608","reported_seq":3014,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184078+0000","last_change":"2024-03-18T18:25:29.043841+0000","last_active":"2024-03-18T18:25:33.184078+0000","last_peered":"2024-03-18T18:25:33.184078+0000","last_clean":"2024-03-18T18:25:33.184078+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:25:33.184078+0000","last_undegraded":"2024-03-18T18:25:33.184078+0000","last_fullsized":"2024-03-18T18:25:33.184078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.32","version":"54'3871","reported_seq":3170,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798177+0000","last_change":"2024-03-18T18:25:29.047066+0000","last_active":"2024-03-18T18:25:32.798177+0000","last_peered":"2024-03-18T18:25:32.798177+0000","last_clean":"2024-03-18T18:25:32.798177+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:32.798177+0000","last_undegraded":"2024-03-18T18:25:32.798177+0000","last_fullsized":"2024-03-18T18:25:32.798177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.31","version":"54'3829","reported_seq":3152,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746701+0000","last_change":"2024-03-18T18:25:29.032597+0000","last_active":"2024-03-18T18:25:32.746701+0000","last_peered":"2024-03-18T18:25:32.746701+0000","last_clean":"2024-03-18T18:25:32.746701+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:25:32.746701+0000","last_undegraded":"2024-03-18T18:25:32.746701+0000","last_fullsized":"2024-03-18T18:25:32.746701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.30","version":"54'4022","reported_seq":3326,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.626154+0000","last_change":"2024-03-18T18:25:29.024791+0000","last_active":"2024-03-18T18:25:30.626154+0000","last_peered":"2024-03-18T18:25:30.626154+0000","last_clean":"2024-03-18T18:25:30.626154+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:25:30.626154+0000","last_undegraded":"2024-03-18T18:25:30.626154+0000","last_fullsized":"2024-03-18T18:25:30.626154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2f","version":"54'3787","reported_seq":3090,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.407396+0000","last_change":"2024-03-18T18:25:29.030461+0000","last_active":"2024-03-18T18:25:30.407396+0000","last_peered":"2024-03-18T18:25:30.407396+0000","last_clean":"2024-03-18T18:25:30.407396+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:25:30.407396+0000","last_undegraded":"2024-03-18T18:25:30.407396+0000","last_fullsized":"2024-03-18T18:25:30.407396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2e","version":"54'3740","reported_seq":3141,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986900+0000","last_change":"2024-03-18T18:25:29.221387+0000","last_active":"2024-03-18T18:25:32.986900+0000","last_peered":"2024-03-18T18:25:32.986900+0000","last_clean":"2024-03-18T18:25:32.986900+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:32.986900+0000","last_undegraded":"2024-03-18T18:25:32.986900+0000","last_fullsized":"2024-03-18T18:25:32.986900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.2d","version":"54'3972","reported_seq":3270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.677987+0000","last_change":"2024-03-18T18:25:29.055765+0000","last_active":"2024-03-18T18:25:30.677987+0000","last_peered":"2024-03-18T18:25:30.677987+0000","last_clean":"2024-03-18T18:25:30.677987+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:25:30.677987+0000","last_undegraded":"2024-03-18T18:25:30.677987+0000","last_fullsized":"2024-03-18T18:25:30.677987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2c","version":"54'3755","reported_seq":3109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.642916+0000","last_change":"2024-03-18T18:25:29.019398+0000","last_active":"2024-03-18T18:25:30.642916+0000","last_peered":"2024-03-18T18:25:30.642916+0000","last_clean":"2024-03-18T18:25:30.642916+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:25:30.642916+0000","last_undegraded":"2024-03-18T18:25:30.642916+0000","last_fullsized":"2024-03-18T18:25:30.642916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2b","version":"54'3495","reported_seq":2913,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798768+0000","last_change":"2024-03-18T18:25:29.059001+0000","last_active":"2024-03-18T18:25:32.798768+0000","last_peered":"2024-03-18T18:25:32.798768+0000","last_clean":"2024-03-18T18:25:32.798768+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:25:32.798768+0000","last_undegraded":"2024-03-18T18:25:32.798768+0000","last_fullsized":"2024-03-18T18:25:32.798768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.2a","version":"54'4356","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.716732+0000","last_change":"2024-03-18T18:25:29.035858+0000","last_active":"2024-03-18T18:25:30.716732+0000","last_peered":"2024-03-18T18:25:30.716732+0000","last_clean":"2024-03-18T18:25:30.716732+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:25:30.716732+0000","last_undegraded":"2024-03-18T18:25:30.716732+0000","last_fullsized":"2024-03-18T18:25:30.716732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4356,"log_dups_size":0,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.29","version":"54'3901","reported_seq":3232,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183300+0000","last_change":"2024-03-18T18:25:29.040440+0000","last_active":"2024-03-18T18:25:33.183300+0000","last_peered":"2024-03-18T18:25:33.183300+0000","last_clean":"2024-03-18T18:25:33.183300+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:25:33.183300+0000","last_undegraded":"2024-03-18T18:25:33.183300+0000","last_fullsized":"2024-03-18T18:25:33.183300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.28","version":"54'4190","reported_seq":3406,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.714777+0000","last_change":"2024-03-18T18:25:29.027847+0000","last_active":"2024-03-18T18:25:30.714777+0000","last_peered":"2024-03-18T18:25:30.714777+0000","last_clean":"2024-03-18T18:25:30.714777+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:25:30.714777+0000","last_undegraded":"2024-03-18T18:25:30.714777+0000","last_fullsized":"2024-03-18T18:25:30.714777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.27","version":"54'3282","reported_seq":2723,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184191+0000","last_change":"2024-03-18T18:25:29.043669+0000","last_active":"2024-03-18T18:25:33.184191+0000","last_peered":"2024-03-18T18:25:33.184191+0000","last_clean":"2024-03-18T18:25:33.184191+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:25:33.184191+0000","last_undegraded":"2024-03-18T18:25:33.184191+0000","last_fullsized":"2024-03-18T18:25:33.184191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.26","version":"54'3776","reported_seq":3134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.457472+0000","last_change":"2024-03-18T18:25:29.022945+0000","last_active":"2024-03-18T18:25:30.457472+0000","last_peered":"2024-03-18T18:25:30.457472+0000","last_clean":"2024-03-18T18:25:30.457472+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:25:30.457472+0000","last_undegraded":"2024-03-18T18:25:30.457472+0000","last_fullsized":"2024-03-18T18:25:30.457472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.25","version":"54'3857","reported_seq":3173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746541+0000","last_change":"2024-03-18T18:25:29.046199+0000","last_active":"2024-03-18T18:25:32.746541+0000","last_peered":"2024-03-18T18:25:32.746541+0000","last_clean":"2024-03-18T18:25:32.746541+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:25:32.746541+0000","last_undegraded":"2024-03-18T18:25:32.746541+0000","last_fullsized":"2024-03-18T18:25:32.746541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3857,"log_dups_size":0,"ondisk_log_size":3857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.24","version":"54'3360","reported_seq":2802,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.185162+0000","last_change":"2024-03-18T18:25:29.046208+0000","last_active":"2024-03-18T18:25:33.185162+0000","last_peered":"2024-03-18T18:25:33.185162+0000","last_clean":"2024-03-18T18:25:33.185162+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:25:33.185162+0000","last_undegraded":"2024-03-18T18:25:33.185162+0000","last_fullsized":"2024-03-18T18:25:33.185162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.23","version":"54'3862","reported_seq":3200,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798386+0000","last_change":"2024-03-18T18:25:29.058196+0000","last_active":"2024-03-18T18:25:32.798386+0000","last_peered":"2024-03-18T18:25:32.798386+0000","last_clean":"2024-03-18T18:25:32.798386+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:25:32.798386+0000","last_undegraded":"2024-03-18T18:25:32.798386+0000","last_fullsized":"2024-03-18T18:25:32.798386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.22","version":"54'3274","reported_seq":2720,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.711595+0000","last_change":"2024-03-18T18:25:29.038378+0000","last_active":"2024-03-18T18:25:30.711595+0000","last_peered":"2024-03-18T18:25:30.711595+0000","last_clean":"2024-03-18T18:25:30.711595+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:25:30.711595+0000","last_undegraded":"2024-03-18T18:25:30.711595+0000","last_fullsized":"2024-03-18T18:25:30.711595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.21","version":"54'4260","reported_seq":3501,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986680+0000","last_change":"2024-03-18T18:25:29.230579+0000","last_active":"2024-03-18T18:25:32.986680+0000","last_peered":"2024-03-18T18:25:32.986680+0000","last_clean":"2024-03-18T18:25:32.986680+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:32.986680+0000","last_undegraded":"2024-03-18T18:25:32.986680+0000","last_fullsized":"2024-03-18T18:25:32.986680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4260,"log_dups_size":0,"ondisk_log_size":4260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.20","version":"54'3981","reported_seq":3267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629516+0000","last_change":"2024-03-18T18:25:29.022937+0000","last_active":"2024-03-18T18:25:30.629516+0000","last_peered":"2024-03-18T18:25:30.629516+0000","last_clean":"2024-03-18T18:25:30.629516+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:25:30.629516+0000","last_undegraded":"2024-03-18T18:25:30.629516+0000","last_fullsized":"2024-03-18T18:25:30.629516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":3,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"54'4040","reported_seq":3306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.631280+0000","last_change":"2024-03-18T18:25:29.190915+0000","last_active":"2024-03-18T18:25:30.631280+0000","last_peered":"2024-03-18T18:25:30.631280+0000","last_clean":"2024-03-18T18:25:30.631280+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:30.631280+0000","last_undegraded":"2024-03-18T18:25:30.631280+0000","last_fullsized":"2024-03-18T18:25:30.631280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4040,"log_dups_size":0,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1b","version":"48'1439","reported_seq":1489,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.031560+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:25:29.031560+0000","last_peered":"2024-03-18T18:25:29.031560+0000","last_clean":"2024-03-18T18:25:29.031560+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:29.031560+0000","last_undegraded":"2024-03-18T18:25:29.031560+0000","last_fullsized":"2024-03-18T18:25:29.031560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2981,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798690+0000","last_change":"2024-03-18T18:25:29.062033+0000","last_active":"2024-03-18T18:25:32.798690+0000","last_peered":"2024-03-18T18:25:32.798690+0000","last_clean":"2024-03-18T18:25:32.798690+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:32.798690+0000","last_undegraded":"2024-03-18T18:25:32.798690+0000","last_fullsized":"2024-03-18T18:25:32.798690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1a","version":"54'3527","reported_seq":3576,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.999798+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:25:28.999798+0000","last_peered":"2024-03-18T18:25:28.999798+0000","last_clean":"2024-03-18T18:25:28.999798+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:28.999798+0000","last_undegraded":"2024-03-18T18:25:28.999798+0000","last_fullsized":"2024-03-18T18:25:28.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"50'679","reported_seq":729,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.028140+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:25:29.028140+0000","last_peered":"2024-03-18T18:25:29.028140+0000","last_clean":"2024-03-18T18:25:29.028140+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:29.028140+0000","last_undegraded":"2024-03-18T18:25:29.028140+0000","last_fullsized":"2024-03-18T18:25:29.028140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"54'4461","reported_seq":3633,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.182868+0000","last_change":"2024-03-18T18:25:29.040660+0000","last_active":"2024-03-18T18:25:33.182868+0000","last_peered":"2024-03-18T18:25:33.182868+0000","last_clean":"2024-03-18T18:25:33.182868+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:25:33.182868+0000","last_undegraded":"2024-03-18T18:25:33.182868+0000","last_fullsized":"2024-03-18T18:25:33.182868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.18","version":"50'5546","reported_seq":5595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.995891+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:25:27.995891+0000","last_peered":"2024-03-18T18:25:27.995891+0000","last_clean":"2024-03-18T18:25:27.995891+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:27.995891+0000","last_undegraded":"2024-03-18T18:25:27.995891+0000","last_fullsized":"2024-03-18T18:25:27.995891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5546,"log_dups_size":0,"ondisk_log_size":5546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"54'3911","reported_seq":3234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.747326+0000","last_change":"2024-03-18T18:25:29.032708+0000","last_active":"2024-03-18T18:25:32.747326+0000","last_peered":"2024-03-18T18:25:32.747326+0000","last_clean":"2024-03-18T18:25:32.747326+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:25:32.747326+0000","last_undegraded":"2024-03-18T18:25:32.747326+0000","last_fullsized":"2024-03-18T18:25:32.747326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.17","version":"54'1835","reported_seq":1884,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.551150+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:25:30.551150+0000","last_peered":"2024-03-18T18:25:30.551150+0000","last_clean":"2024-03-18T18:25:30.551150+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:30.551150+0000","last_undegraded":"2024-03-18T18:25:30.551150+0000","last_fullsized":"2024-03-18T18:25:30.551150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17202751,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1942,"num_write_kb":18495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"54'3669","reported_seq":3075,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.660214+0000","last_change":"2024-03-18T18:25:29.027139+0000","last_active":"2024-03-18T18:25:30.660214+0000","last_peered":"2024-03-18T18:25:30.660214+0000","last_clean":"2024-03-18T18:25:30.660214+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:25:30.660214+0000","last_undegraded":"2024-03-18T18:25:30.660214+0000","last_fullsized":"2024-03-18T18:25:30.660214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.16","version":"50'2293","reported_seq":2342,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.997045+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:25:27.997045+0000","last_peered":"2024-03-18T18:25:27.997045+0000","last_clean":"2024-03-18T18:25:27.997045+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:27.997045+0000","last_undegraded":"2024-03-18T18:25:27.997045+0000","last_fullsized":"2024-03-18T18:25:27.997045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"54'3704","reported_seq":3070,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.800565+0000","last_change":"2024-03-18T18:25:29.055272+0000","last_active":"2024-03-18T18:25:32.800565+0000","last_peered":"2024-03-18T18:25:32.800565+0000","last_clean":"2024-03-18T18:25:32.800565+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:32.800565+0000","last_undegraded":"2024-03-18T18:25:32.800565+0000","last_fullsized":"2024-03-18T18:25:32.800565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.15","version":"54'2695","reported_seq":2745,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.310867+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:25:31.310867+0000","last_peered":"2024-03-18T18:25:31.310867+0000","last_clean":"2024-03-18T18:25:31.310867+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:25:31.310867+0000","last_undegraded":"2024-03-18T18:25:31.310867+0000","last_fullsized":"2024-03-18T18:25:31.310867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"54'3872","reported_seq":3229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.627683+0000","last_change":"2024-03-18T18:25:29.195869+0000","last_active":"2024-03-18T18:25:30.627683+0000","last_peered":"2024-03-18T18:25:30.627683+0000","last_clean":"2024-03-18T18:25:30.627683+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:30.627683+0000","last_undegraded":"2024-03-18T18:25:30.627683+0000","last_fullsized":"2024-03-18T18:25:30.627683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.14","version":"50'3867","reported_seq":3916,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.105272+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:25:28.105272+0000","last_peered":"2024-03-18T18:25:28.105272+0000","last_clean":"2024-03-18T18:25:28.105272+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:28.105272+0000","last_undegraded":"2024-03-18T18:25:28.105272+0000","last_fullsized":"2024-03-18T18:25:28.105272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3867,"log_dups_size":0,"ondisk_log_size":3867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3978,"num_write_kb":30874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"54'3911","reported_seq":3206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.666167+0000","last_change":"2024-03-18T18:25:29.054617+0000","last_active":"2024-03-18T18:25:30.666167+0000","last_peered":"2024-03-18T18:25:30.666167+0000","last_clean":"2024-03-18T18:25:30.666167+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:25:30.666167+0000","last_undegraded":"2024-03-18T18:25:30.666167+0000","last_fullsized":"2024-03-18T18:25:30.666167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.13","version":"50'2794","reported_seq":2845,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799151+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:25:32.799151+0000","last_peered":"2024-03-18T18:25:32.799151+0000","last_clean":"2024-03-18T18:25:32.799151+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:32.799151+0000","last_undegraded":"2024-03-18T18:25:32.799151+0000","last_fullsized":"2024-03-18T18:25:32.799151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2794,"log_dups_size":0,"ondisk_log_size":2794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"54'3870","reported_seq":3181,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798503+0000","last_change":"2024-03-18T18:25:29.049751+0000","last_active":"2024-03-18T18:25:32.798503+0000","last_peered":"2024-03-18T18:25:32.798503+0000","last_clean":"2024-03-18T18:25:32.798503+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:32.798503+0000","last_undegraded":"2024-03-18T18:25:32.798503+0000","last_fullsized":"2024-03-18T18:25:32.798503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.12","version":"54'148","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.004884+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:25:29.004884+0000","last_peered":"2024-03-18T18:25:29.004884+0000","last_clean":"2024-03-18T18:25:29.004884+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:25:29.004884+0000","last_undegraded":"2024-03-18T18:25:29.004884+0000","last_fullsized":"2024-03-18T18:25:29.004884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3403,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.641498+0000","last_change":"2024-03-18T18:25:29.053722+0000","last_active":"2024-03-18T18:25:30.641498+0000","last_peered":"2024-03-18T18:25:30.641498+0000","last_clean":"2024-03-18T18:25:30.641498+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:25:30.641498+0000","last_undegraded":"2024-03-18T18:25:30.641498+0000","last_fullsized":"2024-03-18T18:25:30.641498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.11","version":"48'1126","reported_seq":1175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.104928+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:25:28.104928+0000","last_peered":"2024-03-18T18:25:28.104928+0000","last_clean":"2024-03-18T18:25:28.104928+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:28.104928+0000","last_undegraded":"2024-03-18T18:25:28.104928+0000","last_fullsized":"2024-03-18T18:25:28.104928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"54'3648","reported_seq":2965,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629417+0000","last_change":"2024-03-18T18:25:29.016810+0000","last_active":"2024-03-18T18:25:30.629417+0000","last_peered":"2024-03-18T18:25:30.629417+0000","last_clean":"2024-03-18T18:25:30.629417+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:25:30.629417+0000","last_undegraded":"2024-03-18T18:25:30.629417+0000","last_fullsized":"2024-03-18T18:25:30.629417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3648,"log_dups_size":0,"ondisk_log_size":3648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.10","version":"54'1551","reported_seq":1602,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986702+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:25:32.986702+0000","last_peered":"2024-03-18T18:25:32.986702+0000","last_clean":"2024-03-18T18:25:32.986702+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:32.986702+0000","last_undegraded":"2024-03-18T18:25:32.986702+0000","last_fullsized":"2024-03-18T18:25:32.986702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"54'4132","reported_seq":3360,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.676821+0000","last_change":"2024-03-18T18:25:29.051925+0000","last_active":"2024-03-18T18:25:30.676821+0000","last_peered":"2024-03-18T18:25:30.676821+0000","last_clean":"2024-03-18T18:25:30.676821+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:25:30.676821+0000","last_undegraded":"2024-03-18T18:25:30.676821+0000","last_fullsized":"2024-03-18T18:25:30.676821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4132,"log_dups_size":0,"ondisk_log_size":4132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.f","version":"48'1388","reported_seq":1438,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.108197+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:25:28.108197+0000","last_peered":"2024-03-18T18:25:28.108197+0000","last_clean":"2024-03-18T18:25:28.108197+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:28.108197+0000","last_undegraded":"2024-03-18T18:25:28.108197+0000","last_fullsized":"2024-03-18T18:25:28.108197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"54'3700","reported_seq":3040,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.660977+0000","last_change":"2024-03-18T18:25:29.056125+0000","last_active":"2024-03-18T18:25:30.660977+0000","last_peered":"2024-03-18T18:25:30.660977+0000","last_clean":"2024-03-18T18:25:30.660977+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:30.660977+0000","last_undegraded":"2024-03-18T18:25:30.660977+0000","last_fullsized":"2024-03-18T18:25:30.660977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.e","version":"50'1377","reported_seq":1428,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.205286+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:25:29.205286+0000","last_peered":"2024-03-18T18:25:29.205286+0000","last_clean":"2024-03-18T18:25:29.205286+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:29.205286+0000","last_undegraded":"2024-03-18T18:25:29.205286+0000","last_fullsized":"2024-03-18T18:25:29.205286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"54'4065","reported_seq":3351,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.987166+0000","last_change":"2024-03-18T18:25:29.226986+0000","last_active":"2024-03-18T18:25:32.987166+0000","last_peered":"2024-03-18T18:25:32.987166+0000","last_clean":"2024-03-18T18:25:32.987166+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:25:32.987166+0000","last_undegraded":"2024-03-18T18:25:32.987166+0000","last_fullsized":"2024-03-18T18:25:32.987166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4065,"log_dups_size":0,"ondisk_log_size":4065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:22:20.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.d","version":"50'4629","reported_seq":4680,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.998187+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:25:28.998187+0000","last_peered":"2024-03-18T18:25:28.998187+0000","last_clean":"2024-03-18T18:25:28.998187+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:28.998187+0000","last_undegraded":"2024-03-18T18:25:28.998187+0000","last_fullsized":"2024-03-18T18:25:28.998187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3738","reported_seq":3058,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.703287+0000","last_change":"2024-03-18T18:25:29.033548+0000","last_active":"2024-03-18T18:25:30.703287+0000","last_peered":"2024-03-18T18:25:30.703287+0000","last_clean":"2024-03-18T18:25:30.703287+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:25:30.703287+0000","last_undegraded":"2024-03-18T18:25:30.703287+0000","last_fullsized":"2024-03-18T18:25:30.703287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3738,"log_dups_size":0,"ondisk_log_size":3738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.c","version":"48'5034","reported_seq":5085,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.205485+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:25:29.205485+0000","last_peered":"2024-03-18T18:25:29.205485+0000","last_clean":"2024-03-18T18:25:29.205485+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:29.205485+0000","last_undegraded":"2024-03-18T18:25:29.205485+0000","last_fullsized":"2024-03-18T18:25:29.205485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5034,"log_dups_size":0,"ondisk_log_size":5034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'3518","reported_seq":2894,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.676401+0000","last_change":"2024-03-18T18:25:29.055382+0000","last_active":"2024-03-18T18:25:30.676401+0000","last_peered":"2024-03-18T18:25:30.676401+0000","last_clean":"2024-03-18T18:25:30.676401+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:25:30.676401+0000","last_undegraded":"2024-03-18T18:25:30.676401+0000","last_fullsized":"2024-03-18T18:25:30.676401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3518,"log_dups_size":0,"ondisk_log_size":3518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:00.566254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.103195+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:25:28.103195+0000","last_peered":"2024-03-18T18:25:28.103195+0000","last_clean":"2024-03-18T18:25:28.103195+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:28.103195+0000","last_undegraded":"2024-03-18T18:25:28.103195+0000","last_fullsized":"2024-03-18T18:25:28.103195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"50'1920","reported_seq":1970,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.996090+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:25:27.996090+0000","last_peered":"2024-03-18T18:25:27.996090+0000","last_clean":"2024-03-18T18:25:27.996090+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:27.996090+0000","last_undegraded":"2024-03-18T18:25:27.996090+0000","last_fullsized":"2024-03-18T18:25:27.996090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184197+0000","last_change":"2024-03-18T18:25:29.046186+0000","last_active":"2024-03-18T18:25:33.184197+0000","last_peered":"2024-03-18T18:25:33.184197+0000","last_clean":"2024-03-18T18:25:33.184197+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:33.184197+0000","last_undegraded":"2024-03-18T18:25:33.184197+0000","last_fullsized":"2024-03-18T18:25:33.184197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.0","version":"50'4975","reported_seq":5026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.103154+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:25:28.103154+0000","last_peered":"2024-03-18T18:25:28.103154+0000","last_clean":"2024-03-18T18:25:28.103154+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:28.103154+0000","last_undegraded":"2024-03-18T18:25:28.103154+0000","last_fullsized":"2024-03-18T18:25:28.103154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4975,"log_dups_size":0,"ondisk_log_size":4975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2932,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.797905+0000","last_change":"2024-03-18T18:25:29.042446+0000","last_active":"2024-03-18T18:25:32.797905+0000","last_peered":"2024-03-18T18:25:32.797905+0000","last_clean":"2024-03-18T18:25:32.797905+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:32.797905+0000","last_undegraded":"2024-03-18T18:25:32.797905+0000","last_fullsized":"2024-03-18T18:25:32.797905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1","version":"54'2669","reported_seq":3260,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.301894+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:25:31.301894+0000","last_peered":"2024-03-18T18:25:31.301894+0000","last_clean":"2024-03-18T18:25:31.301894+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:31.301894+0000","last_undegraded":"2024-03-18T18:25:31.301894+0000","last_fullsized":"2024-03-18T18:25:31.301894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"54'4235","reported_seq":3482,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746406+0000","last_change":"2024-03-18T18:25:29.032416+0000","last_active":"2024-03-18T18:25:32.746406+0000","last_peered":"2024-03-18T18:25:32.746406+0000","last_clean":"2024-03-18T18:25:32.746406+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:25:32.746406+0000","last_undegraded":"2024-03-18T18:25:32.746406+0000","last_fullsized":"2024-03-18T18:25:32.746406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4235,"log_dups_size":0,"ondisk_log_size":4235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.2","version":"50'5920","reported_seq":5970,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.996813+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:25:27.996813+0000","last_peered":"2024-03-18T18:25:27.996813+0000","last_clean":"2024-03-18T18:25:27.996813+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:27.996813+0000","last_undegraded":"2024-03-18T18:25:27.996813+0000","last_fullsized":"2024-03-18T18:25:27.996813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5920,"log_dups_size":0,"ondisk_log_size":5920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3974","reported_seq":3243,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.620681+0000","last_change":"2024-03-18T18:25:29.192820+0000","last_active":"2024-03-18T18:25:30.620681+0000","last_peered":"2024-03-18T18:25:30.620681+0000","last_clean":"2024-03-18T18:25:30.620681+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:30.620681+0000","last_undegraded":"2024-03-18T18:25:30.620681+0000","last_fullsized":"2024-03-18T18:25:30.620681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.4","version":"54'954","reported_seq":1005,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.299607+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:25:31.299607+0000","last_peered":"2024-03-18T18:25:31.299607+0000","last_clean":"2024-03-18T18:25:31.299607+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:31.299607+0000","last_undegraded":"2024-03-18T18:25:31.299607+0000","last_fullsized":"2024-03-18T18:25:31.299607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"54'3615","reported_seq":3002,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.690582+0000","last_change":"2024-03-18T18:25:29.037811+0000","last_active":"2024-03-18T18:25:30.690582+0000","last_peered":"2024-03-18T18:25:30.690582+0000","last_clean":"2024-03-18T18:25:30.690582+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:25:30.690582+0000","last_undegraded":"2024-03-18T18:25:30.690582+0000","last_fullsized":"2024-03-18T18:25:30.690582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.5","version":"48'3704","reported_seq":3754,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106822+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:25:28.106822+0000","last_peered":"2024-03-18T18:25:28.106822+0000","last_clean":"2024-03-18T18:25:28.106822+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:25:28.106822+0000","last_undegraded":"2024-03-18T18:25:28.106822+0000","last_fullsized":"2024-03-18T18:25:28.106822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3185,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746463+0000","last_change":"2024-03-18T18:25:29.039953+0000","last_active":"2024-03-18T18:25:32.746463+0000","last_peered":"2024-03-18T18:25:32.746463+0000","last_clean":"2024-03-18T18:25:32.746463+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:25:32.746463+0000","last_undegraded":"2024-03-18T18:25:32.746463+0000","last_fullsized":"2024-03-18T18:25:32.746463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.6","version":"54'2145","reported_seq":2196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.011889+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:25:31.011889+0000","last_peered":"2024-03-18T18:25:31.011889+0000","last_clean":"2024-03-18T18:25:31.011889+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:31.011889+0000","last_undegraded":"2024-03-18T18:25:31.011889+0000","last_fullsized":"2024-03-18T18:25:31.011889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2145,"log_dups_size":0,"ondisk_log_size":2145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2812,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184726+0000","last_change":"2024-03-18T18:25:29.044961+0000","last_active":"2024-03-18T18:25:33.184726+0000","last_peered":"2024-03-18T18:25:33.184726+0000","last_clean":"2024-03-18T18:25:33.184726+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:25:33.184726+0000","last_undegraded":"2024-03-18T18:25:33.184726+0000","last_fullsized":"2024-03-18T18:25:33.184726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.7","version":"50'1819","reported_seq":1869,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106751+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:25:28.106751+0000","last_peered":"2024-03-18T18:25:28.106751+0000","last_clean":"2024-03-18T18:25:28.106751+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:28.106751+0000","last_undegraded":"2024-03-18T18:25:28.106751+0000","last_fullsized":"2024-03-18T18:25:28.106751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1819,"log_dups_size":0,"ondisk_log_size":1819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'3540","reported_seq":2943,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799415+0000","last_change":"2024-03-18T18:25:29.063216+0000","last_active":"2024-03-18T18:25:32.799415+0000","last_peered":"2024-03-18T18:25:32.799415+0000","last_clean":"2024-03-18T18:25:32.799415+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:32.799415+0000","last_undegraded":"2024-03-18T18:25:32.799415+0000","last_fullsized":"2024-03-18T18:25:32.799415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.8","version":"48'1602","reported_seq":1652,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.102909+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:25:28.102909+0000","last_peered":"2024-03-18T18:25:28.102909+0000","last_clean":"2024-03-18T18:25:28.102909+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:25:28.102909+0000","last_undegraded":"2024-03-18T18:25:28.102909+0000","last_fullsized":"2024-03-18T18:25:28.102909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1602,"log_dups_size":0,"ondisk_log_size":1602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"54'3735","reported_seq":3026,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.477612+0000","last_change":"2024-03-18T18:25:29.194592+0000","last_active":"2024-03-18T18:25:30.477612+0000","last_peered":"2024-03-18T18:25:30.477612+0000","last_clean":"2024-03-18T18:25:30.477612+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:30.477612+0000","last_undegraded":"2024-03-18T18:25:30.477612+0000","last_fullsized":"2024-03-18T18:25:30.477612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3735,"log_dups_size":0,"ondisk_log_size":3735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.9","version":"50'2478","reported_seq":2529,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.997253+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:25:28.997253+0000","last_peered":"2024-03-18T18:25:28.997253+0000","last_clean":"2024-03-18T18:25:28.997253+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:28.997253+0000","last_undegraded":"2024-03-18T18:25:28.997253+0000","last_fullsized":"2024-03-18T18:25:28.997253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2478,"log_dups_size":0,"ondisk_log_size":2478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"54'3993","reported_seq":3320,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183031+0000","last_change":"2024-03-18T18:25:29.042734+0000","last_active":"2024-03-18T18:25:33.183031+0000","last_peered":"2024-03-18T18:25:33.183031+0000","last_clean":"2024-03-18T18:25:33.183031+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:33.183031+0000","last_undegraded":"2024-03-18T18:25:33.183031+0000","last_fullsized":"2024-03-18T18:25:33.183031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.a","version":"50'2622","reported_seq":2673,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.997606+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:25:28.997606+0000","last_peered":"2024-03-18T18:25:28.997606+0000","last_clean":"2024-03-18T18:25:28.997606+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:28.997606+0000","last_undegraded":"2024-03-18T18:25:28.997606+0000","last_fullsized":"2024-03-18T18:25:28.997606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2622,"log_dups_size":0,"ondisk_log_size":2622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'3488","reported_seq":2910,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184638+0000","last_change":"2024-03-18T18:25:29.044854+0000","last_active":"2024-03-18T18:25:33.184638+0000","last_peered":"2024-03-18T18:25:33.184638+0000","last_clean":"2024-03-18T18:25:33.184638+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:25:33.184638+0000","last_undegraded":"2024-03-18T18:25:33.184638+0000","last_fullsized":"2024-03-18T18:25:33.184638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.b","version":"48'4482","reported_seq":4532,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106243+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:25:28.106243+0000","last_peered":"2024-03-18T18:25:28.106243+0000","last_clean":"2024-03-18T18:25:28.106243+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:25:28.106243+0000","last_undegraded":"2024-03-18T18:25:28.106243+0000","last_fullsized":"2024-03-18T18:25:28.106243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4482,"log_dups_size":0,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"54'3776","reported_seq":3131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.598753+0000","last_change":"2024-03-18T18:25:29.014675+0000","last_active":"2024-03-18T18:25:30.598753+0000","last_peered":"2024-03-18T18:25:30.598753+0000","last_clean":"2024-03-18T18:25:30.598753+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:25:30.598753+0000","last_undegraded":"2024-03-18T18:25:30.598753+0000","last_fullsized":"2024-03-18T18:25:30.598753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"54'3708","reported_seq":3115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.700610+0000","last_change":"2024-03-18T18:25:29.035433+0000","last_active":"2024-03-18T18:25:30.700610+0000","last_peered":"2024-03-18T18:25:30.700610+0000","last_clean":"2024-03-18T18:25:30.700610+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:25:30.700610+0000","last_undegraded":"2024-03-18T18:25:30.700610+0000","last_fullsized":"2024-03-18T18:25:30.700610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3708,"log_dups_size":0,"ondisk_log_size":3708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":3,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1c","version":"51'1387","reported_seq":1436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.105343+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:25:28.105343+0000","last_peered":"2024-03-18T18:25:28.105343+0000","last_clean":"2024-03-18T18:25:28.105343+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:25:28.105343+0000","last_undegraded":"2024-03-18T18:25:28.105343+0000","last_fullsized":"2024-03-18T18:25:28.105343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4100","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.702015+0000","last_change":"2024-03-18T18:25:29.032671+0000","last_active":"2024-03-18T18:25:30.702015+0000","last_peered":"2024-03-18T18:25:30.702015+0000","last_clean":"2024-03-18T18:25:30.702015+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:25:30.702015+0000","last_undegraded":"2024-03-18T18:25:30.702015+0000","last_fullsized":"2024-03-18T18:25:30.702015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1d","version":"50'3529","reported_seq":3578,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106016+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:25:28.106016+0000","last_peered":"2024-03-18T18:25:28.106016+0000","last_clean":"2024-03-18T18:25:28.106016+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:25:28.106016+0000","last_undegraded":"2024-03-18T18:25:28.106016+0000","last_fullsized":"2024-03-18T18:25:28.106016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"54'3441","reported_seq":2892,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799819+0000","last_change":"2024-03-18T18:25:29.053757+0000","last_active":"2024-03-18T18:25:32.799819+0000","last_peered":"2024-03-18T18:25:32.799819+0000","last_clean":"2024-03-18T18:25:32.799819+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:25:32.799819+0000","last_undegraded":"2024-03-18T18:25:32.799819+0000","last_fullsized":"2024-03-18T18:25:32.799819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1e","version":"50'3382","reported_seq":3434,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.034174+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:25:29.034174+0000","last_peered":"2024-03-18T18:25:29.034174+0000","last_clean":"2024-03-18T18:25:29.034174+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:29.034174+0000","last_undegraded":"2024-03-18T18:25:29.034174+0000","last_fullsized":"2024-03-18T18:25:29.034174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"54'3368","reported_seq":2785,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184383+0000","last_change":"2024-03-18T18:25:29.047446+0000","last_active":"2024-03-18T18:25:33.184383+0000","last_peered":"2024-03-18T18:25:33.184383+0000","last_clean":"2024-03-18T18:25:33.184383+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:25:33.184383+0000","last_undegraded":"2024-03-18T18:25:33.184383+0000","last_fullsized":"2024-03-18T18:25:33.184383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1f","version":"50'1528","reported_seq":1579,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.006189+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:25:29.006189+0000","last_peered":"2024-03-18T18:25:29.006189+0000","last_clean":"2024-03-18T18:25:29.006189+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:29.006189+0000","last_undegraded":"2024-03-18T18:25:29.006189+0000","last_fullsized":"2024-03-18T18:25:29.006189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127205,"num_objects":128,"num_object_clones":28,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":13,"num_read":31,"num_read_kb":21,"num_write":75036,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":254396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241878,"ondisk_log_size":241878,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264160439,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88568,"num_write_kb":694604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384000,"data_stored":528320878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85044,"ondisk_log_size":85044,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476938,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404708,"kb_used_data":66780,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967132,"statfs":{"total":96636764160,"available":96222343168,"internally_reserved":0,"allocated":68382720,"data_stored":68015462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.628,"15min":0.69599999999999995},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.82099999999999995,"5min":1.119,"15min":5.4859999999999998},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83899999999999997,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.79400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.099,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.80800000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":1.05,"15min":1.5009999999999999},"last":1.113}]},{"osd":2,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.68600000000000005,"15min":0.755},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.3700000000000001},"last":0.996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78500000000000003,"15min":0.82499999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.135,"5min":1.655,"15min":5.452},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79200000000000004,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99099999999999999,"5min":1.5349999999999999,"15min":2.5859999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.69699999999999995,"15min":0.76000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":1.726,"15min":1.726},"last":1.079},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.78500000000000003,"15min":0.83199999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":1.0640000000000001,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.76700000000000002,"15min":0.88600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.171,"5min":1.4890000000000001,"15min":4.1150000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.85899999999999999,"15min":0.94799999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1479999999999999,"5min":1.6240000000000001,"15min":4.2350000000000003},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.90000000000000002,"15min":0.94399999999999995},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":2.0379999999999998,"5min":3.024,"15min":4.1840000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.85099999999999998,"15min":0.95399999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":3.1709999999999998,"15min":5.431},"last":1.0509999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366720,"kb_used_data":78904,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94005120,"statfs":{"total":96636764160,"available":96261242880,"internally_reserved":0,"allocated":80797696,"data_stored":80441792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.76200000000000001},"min":{"1min":0.28899999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1060000000000001,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91800000000000004,"15min":0.84099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.224,"5min":10.127000000000001,"15min":10.127000000000001},"last":1.073}]},{"osd":1,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95099999999999996,"15min":0.81999999999999995},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":12.565,"15min":12.565},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.087,"15min":0.88300000000000001},"min":{"1min":0.42199999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":16.579999999999998,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.995}]},{"osd":2,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.76400000000000001},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.6859999999999999,"5min":6.202,"15min":6.202},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.157,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.98799999999999999,"15min":0.90200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.1320000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.113,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.33500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.208,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.45000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.726,"5min":10.08,"15min":10.08},"last":1.1399999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.83199999999999996,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":27.231000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.054,"15min":1.113},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.351,"5min":9.2509999999999994,"15min":27.478999999999999},"last":1.046}]},{"osd":7,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.56999999999999995,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4570000000000001,"5min":10.182,"15min":10.182},"last":1.206},{"interface":"front","average":{"1min":1.02,"5min":0.86099999999999999,"15min":0.95499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.474,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.103}]}]},{"osd":5,"up_from":16,"seq":68719476938,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513464,"kb_used_data":103344,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93858376,"statfs":{"total":96636764160,"available":96110977024,"internally_reserved":0,"allocated":105824256,"data_stored":105454885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":2.073,"5min":2.073,"15min":3.6739999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.7150000000000001,"5min":0.874,"15min":0.80800000000000005},"min":{"1min":0.57399999999999995,"5min":0.255,"15min":0.255},"max":{"1min":20.013000000000002,"5min":20.013000000000002,"15min":20.013000000000002},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":7.2469999999999999,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.3160000000000001,"5min":0.85799999999999998,"15min":0.83199999999999996},"min":{"1min":0.48199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.231,"5min":10.231,"15min":10.231},"last":0.75}]},{"osd":2,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":0.876,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.041,"5min":12.041,"15min":12.041},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.317,"15min":0.317},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":0.999,"15min":0.92600000000000005},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":16.183,"5min":16.183,"15min":16.183},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.125,"5min":0.89000000000000001,"15min":0.97199999999999998},"min":{"1min":0.61799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":13.678000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.71499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.85799999999999998,"15min":0.90300000000000002},"min":{"1min":0.74399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":0.94599999999999995}]},{"osd":6,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.89000000000000001,"15min":0.93200000000000005},"min":{"1min":0.66300000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.89000000000000001,"15min":0.94499999999999995},"min":{"1min":0.64800000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.0860000000000001,"15min":1.0549999999999999},"min":{"1min":0.63500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.766,"5min":12.766,"15min":12.766},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.091,"15min":1.083},"min":{"1min":0.77700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":12.788,"5min":12.788,"15min":12.788},"last":1.03}]}]},{"osd":4,"up_from":16,"seq":68719476936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422104,"kb_used_data":53900,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":93949736,"statfs":{"total":96636764160,"available":96204529664,"internally_reserved":0,"allocated":55193600,"data_stored":54833645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.8109999999999999,"5min":2.536,"15min":2.536},"last":0.88},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.64500000000000002,"15min":0.69899999999999995},"min":{"1min":0.252,"5min":0.251,"15min":0.251},"max":{"1min":0.81200000000000006,"5min":1.335,"15min":1.946},"last":0.73599999999999999}]},{"osd":1,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.93400000000000005,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.73599999999999999,"15min":0.80400000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.1970000000000001,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.80600000000000005,"15min":0.84899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.046}]},{"osd":3,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.81699999999999995},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.877,"15min":0.89600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.012,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.77800000000000002,"15min":0.84999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":2.613,"15min":4.7119999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.80500000000000005,"15min":0.89000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0609999999999999,"5min":1.393,"15min":4.7480000000000002},"last":0.84899999999999998}]},{"osd":6,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.85699999999999998,"15min":0.91100000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4770000000000001,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.88700000000000001,"15min":0.96099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.2190000000000001,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.84899999999999998,"15min":0.93700000000000006},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.141,"5min":1.3979999999999999,"15min":3.96},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.96499999999999997,"15min":1.0269999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.1830000000000001,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.1040000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509642,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260828,"kb_used_data":45200,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111012,"statfs":{"total":96636764160,"available":96369676288,"internally_reserved":0,"allocated":46284800,"data_stored":45930721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.20499999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.65000000000000002,"15min":0.67700000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.4039999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90900000000000003,"5min":1.1759999999999999,"15min":1.3149999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.78600000000000003,"15min":0.76700000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0209999999999999,"5min":1.216,"15min":1.3},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":0.84899999999999998,"15min":0.78000000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.778,"5min":12.778,"15min":12.778},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":0.94399999999999995,"15min":0.82199999999999995},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":12.84,"5min":12.84,"15min":12.84},"last":0.71599999999999997}]},{"osd":4,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.82999999999999996,"15min":0.85599999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0760000000000001,"5min":1.526,"15min":1.526},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.99399999999999999,"15min":0.95999999999999996},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.9729999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.0920000000000001,"15min":1.0149999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":12.807,"5min":12.807,"15min":12.807},"last":1.169},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.1599999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":19.149000000000001,"5min":19.149000000000001,"15min":19.149000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.244,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.012},{"interface":"front","average":{"1min":0.83899999999999997,"5min":1.02,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.6859999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2030000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.052},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.0469999999999999,"15min":1.073},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.27,"5min":1.518,"15min":1.8320000000000001},"last":1.071}]}]},{"osd":1,"up_from":15,"seq":64424509642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410660,"kb_used_data":90776,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961180,"statfs":{"total":96636764160,"available":96216248320,"internally_reserved":0,"allocated":92954624,"data_stored":92588564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.1359999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.0189999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0620000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.80800000000000005},"min":{"1min":0.38100000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.0289999999999999,"5min":2.8170000000000002,"15min":4.069},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.88700000000000001,"15min":0.86399999999999999},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.339,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2130000000000001,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":1.0209999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0740000000000001},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.29,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.48699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.91600000000000004}]},{"osd":7,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.56000000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2370000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":4.1509999999999998,"5min":4.1509999999999998,"15min":4.798},"last":0.88200000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542346,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319144,"kb_used_data":49312,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052696,"statfs":{"total":96636764160,"available":96309960704,"internally_reserved":0,"allocated":50495488,"data_stored":50136006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.747},{"interface":"front","average":{"1min":1.1659999999999999,"5min":0.77800000000000002,"15min":0.71299999999999997},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":11.132,"5min":11.132,"15min":11.132},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.30199999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.421,"5min":1.857,"15min":3.3839999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.86399999999999999,"15min":0.78200000000000003},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.331,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.872,"15min":0.876},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.95999999999999996,"15min":0.94699999999999995},"min":{"1min":0.504,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":2.609,"15min":2.609},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":1.008},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.587,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.026}]},{"osd":6,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.6259999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.157,"15min":1.0860000000000001},"min":{"1min":0.54600000000000004,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":13.02,"5min":13.02,"15min":13.02},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":1.893,"15min":1.9139999999999999},"last":1.157}]}]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263656,"kb_used_data":34012,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108184,"statfs":{"total":96636764160,"available":96366780416,"internally_reserved":0,"allocated":34828288,"data_stored":34463059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.68000000000000005,"15min":0.621},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.0229999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.37,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.0140000000000002,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.441},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96599999999999997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.82199999999999995,"15min":0.77100000000000002},"min":{"1min":0.41199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.226,"5min":0.93000000000000005,"15min":0.85599999999999998},"min":{"1min":0.48399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.623}]},{"osd":4,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.66000000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.125,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.94899999999999995}]},{"osd":5,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0169999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":5.0650000000000004,"5min":14.869,"15min":14.869},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0880000000000001,"15min":1.022},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4870000000000001,"5min":14.804,"15min":14.804},"last":0.749}]},{"osd":6,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.157,"15min":1.0660000000000001},"min":{"1min":0.64300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.4049999999999994,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4259999999999999,"5min":2.113,"15min":2.113},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.455,"5min":11.455,"15min":11.455},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.294,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":11.430999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.1459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":105287680,"data_stored":105283225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80125952,"data_stored":80117983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":28709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":32854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:25:35.212 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:25:35.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 Processor -- start 2024-03-18T18:25:35.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 -- start start 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5ae0 0x7f8cd80b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cd813e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80b6a10 con 0x7f8cd81443c0 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80b6400 con 0x7f8cd80b5ae0 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdf237700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80b66a0 con 0x7f8cd813dca0 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdda34700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8cd81443c0 0x7f8cd8144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39812/0 (socket says 172.21.15.94:39812) 2024-03-18T18:25:35.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdda34700 1 -- 172.21.15.94:0/3660605771 learned_addr learned my addr 172.21.15.94:0/3660605771 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cde235700 1 --2- 172.21.15.94:0/3660605771 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5ae0 0x7f8cd80b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdea36700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cd813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479918222 0 0) 0x7f8cd80b6a10 con 0x7f8cd81443c0 2024-03-18T18:25:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.323+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc00035d0 con 0x7f8cd81443c0 2024-03-18T18:25:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871295465 0 0) 0x7f8cc00035d0 con 0x7f8cd81443c0 2024-03-18T18:25:35.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 msgr2=0x7f8cd813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cd813e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5ae0 msgr2=0x7f8cd80b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 --2- 172.21.15.94:0/3660605771 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5ae0 0x7f8cd80b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8071fb0 con 0x7f8cd81443c0 2024-03-18T18:25:35.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f8cc8001670 con 0x7f8cd81443c0 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 >> v1:172.21.15.94:6789/0 conn(0x7f8cd81443c0 legacy=0x7f8cd8144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cc0003a20 0x7f8cc0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc0004870 0x7f8cc0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cc0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80b6400 con 0x7f8cc0003a20 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80b66a0 con 0x7f8cc0004870 2024-03-18T18:25:35.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cc0003a20 0x7f8cc0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc000ba30 con 0x7f8cd813dca0 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdda34700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc0004870 0x7f8cc0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdea36700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cc0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 -- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 msgr2=0x7f8cc0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cc0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 -- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc0004870 msgr2=0x7f8cc0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cc0004870 0x7f8cc0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 -- 172.21.15.94:0/3660605771 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00035d0 con 0x7f8cc0003a20 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdea36700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd813dca0 0x7f8cc0005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cde235700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cc0003a20 0x7f8cc0003e40 secure :-1 s=READY pgs=4485 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009ba0 tx=0x7f8cc00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a597039224cb6b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00e6c0 con 0x7f8cc0003a20 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00e820 con 0x7f8cc0003a20 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdd233700 1 -- 172.21.15.94:0/3660605771 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00eb90 con 0x7f8cc0003a20 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdf237700 1 -- 172.21.15.94:0/3660605771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cc0003a20 msgr2=0x7f8cc0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdf237700 1 --2- 172.21.15.94:0/3660605771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cc0003a20 0x7f8cc0003e40 secure :-1 s=READY pgs=4485 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009ba0 tx=0x7f8cc00058a0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdea36700 1 -- 172.21.15.94:0/3660605771 reap_dead start 2024-03-18T18:25:35.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdf237700 1 -- 172.21.15.94:0/3660605771 shutdown_connections 2024-03-18T18:25:35.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdf237700 1 -- 172.21.15.94:0/3660605771 >> 172.21.15.94:0/3660605771 conn(0x7f8cd806dc40 msgr2=0x7f8cd806e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:35.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdf237700 1 -- 172.21.15.94:0/3660605771 shutdown_connections 2024-03-18T18:25:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.327+0000 7f8cdf237700 1 -- 172.21.15.94:0/3660605771 wait complete. 2024-03-18T18:25:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 Processor -- start 2024-03-18T18:25:35.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 -- start start 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc0003a20 0x7f8cd81dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 0x7f8cd81cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd81d1060 0x7f8cd81d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81caa00 con 0x7f8cd81dcc30 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81cb8f0 con 0x7f8cd81d1060 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81ca4e0 con 0x7f8cc0003a20 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 0x7f8cd81cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 0x7f8cd81cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54664/0 (socket says 172.21.15.94:54664) 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cde235700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc0003a20 0x7f8cd81dc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 -- 172.21.15.94:0/1581011323 learned_addr learned my addr 172.21.15.94:0/1581011323 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdea36700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd81d1060 0x7f8cd81d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 -- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc0003a20 msgr2=0x7f8cd81dc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc0003a20 0x7f8cd81dc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 -- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd81d1060 msgr2=0x7f8cd81d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd81d1060 0x7f8cd81d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.343 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 -- 172.21.15.94:0/1581011323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8140d00 con 0x7f8cd81dcc30 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdea36700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd81d1060 0x7f8cd81d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdda34700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 0x7f8cd81cae20 secure :-1 s=READY pgs=4486 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8007340 tx=0x7f8cc8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800f6c0 con 0x7f8cd81dcc30 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800f820 con 0x7f8cd81dcc30 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800fbb0 con 0x7f8cd81dcc30 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81cbb90 con 0x7f8cd81dcc30 2024-03-18T18:25:35.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.331+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd81cb540 con 0x7f8cd81dcc30 2024-03-18T18:25:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.335+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd8067620 con 0x7f8cd81dcc30 2024-03-18T18:25:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.335+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8cc800fd10 con 0x7f8cd81dcc30 2024-03-18T18:25:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.335+0000 7f8cd6ffd700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8cc4066730 0x7f8cc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.335+0000 7f8cde235700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8cc4066730 0x7f8cc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.335+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8cc8084160 con 0x7f8cd81dcc30 2024-03-18T18:25:35.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.335+0000 7f8cde235700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8cc4066730 0x7f8cc4068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0090b0 tx=0x7f8ccc01e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.343+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8cc80514b0 con 0x7f8cd81dcc30 2024-03-18T18:25:35.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.507+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cd81409b0 con 0x7f8cc4066730 2024-03-18T18:25:35.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.515+0000 7f8cd6ffd700 1 -- 172.21.15.94:0/1581011323 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293057 (secure 0 0 0) 0x7f8cd81409b0 con 0x7f8cc4066730 2024-03-18T18:25:35.521 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8cc4066730 msgr2=0x7f8cc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8cc4066730 0x7f8cc4068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0090b0 tx=0x7f8ccc01e040 comp rx=0 tx=0).stop 2024-03-18T18:25:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 msgr2=0x7f8cd81cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 0x7f8cd81cae20 secure :-1 s=READY pgs=4486 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8007340 tx=0x7f8cc8007650 comp rx=0 tx=0).stop 2024-03-18T18:25:35.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 shutdown_connections 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8cc4066730 0x7f8cc4068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd81d1060 0x7f8cd81d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8cd81dcc30 0x7f8cd81cae20 unknown :-1 s=CLOSED pgs=4486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.519+0000 7f8cdf237700 1 --2- 172.21.15.94:0/1581011323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cc0003a20 0x7f8cd81dc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.523+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 >> 172.21.15.94:0/1581011323 conn(0x7f8cd806dc40 msgr2=0x7f8cd80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.523+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 shutdown_connections 2024-03-18T18:25:35.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.523+0000 7f8cdf237700 1 -- 172.21.15.94:0/1581011323 wait complete. 2024-03-18T18:25:35.526 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:25:35.537 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-03-18T18:25:34.913637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264878012,"num_objects":229,"num_object_clones":28,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":13,"num_read":1722,"num_read_kb":4075,"num_write":163763,"num_write_kb":737620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327039,"ondisk_log_size":327039,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2961284,"kb_used_data":522228,"kb_used_omap":12,"kb_used_meta":2438963,"kb_avail":752013436,"statfs":{"total":773094113280,"available":770061758464,"internally_reserved":0,"allocated":534761472,"data_stored":531864134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2497498684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1118810,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":6,"num_read_kb":7,"num_write":92,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.922055"},"pg_stats":[{"pgid":"3.3f","version":"54'3531","reported_seq":2937,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629972+0000","last_change":"2024-03-18T18:25:29.057112+0000","last_active":"2024-03-18T18:25:30.629972+0000","last_peered":"2024-03-18T18:25:30.629972+0000","last_clean":"2024-03-18T18:25:30.629972+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:25:30.629972+0000","last_undegraded":"2024-03-18T18:25:30.629972+0000","last_fullsized":"2024-03-18T18:25:30.629972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3531,"log_dups_size":0,"ondisk_log_size":3531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3e","version":"54'3322","reported_seq":2747,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746698+0000","last_change":"2024-03-18T18:25:29.045338+0000","last_active":"2024-03-18T18:25:32.746698+0000","last_peered":"2024-03-18T18:25:32.746698+0000","last_clean":"2024-03-18T18:25:32.746698+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:25:32.746698+0000","last_undegraded":"2024-03-18T18:25:32.746698+0000","last_fullsized":"2024-03-18T18:25:32.746698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.3d","version":"54'3570","reported_seq":2978,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798788+0000","last_change":"2024-03-18T18:25:29.051316+0000","last_active":"2024-03-18T18:25:32.798788+0000","last_peered":"2024-03-18T18:25:32.798788+0000","last_clean":"2024-03-18T18:25:32.798788+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:32.798788+0000","last_undegraded":"2024-03-18T18:25:32.798788+0000","last_fullsized":"2024-03-18T18:25:32.798788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.3c","version":"54'3829","reported_seq":3135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.703386+0000","last_change":"2024-03-18T18:25:29.029488+0000","last_active":"2024-03-18T18:25:30.703386+0000","last_peered":"2024-03-18T18:25:30.703386+0000","last_clean":"2024-03-18T18:25:30.703386+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:25:30.703386+0000","last_undegraded":"2024-03-18T18:25:30.703386+0000","last_fullsized":"2024-03-18T18:25:30.703386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3b","version":"54'3564","reported_seq":2926,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.625944+0000","last_change":"2024-03-18T18:25:29.053880+0000","last_active":"2024-03-18T18:25:30.625944+0000","last_peered":"2024-03-18T18:25:30.625944+0000","last_clean":"2024-03-18T18:25:30.625944+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:25:30.625944+0000","last_undegraded":"2024-03-18T18:25:30.625944+0000","last_fullsized":"2024-03-18T18:25:30.625944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3a","version":"54'3681","reported_seq":3009,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986656+0000","last_change":"2024-03-18T18:25:29.226526+0000","last_active":"2024-03-18T18:25:32.986656+0000","last_peered":"2024-03-18T18:25:32.986656+0000","last_clean":"2024-03-18T18:25:32.986656+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:25:32.986656+0000","last_undegraded":"2024-03-18T18:25:32.986656+0000","last_fullsized":"2024-03-18T18:25:32.986656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:13:50.287435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.39","version":"54'3918","reported_seq":3239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.673256+0000","last_change":"2024-03-18T18:25:29.050955+0000","last_active":"2024-03-18T18:25:30.673256+0000","last_peered":"2024-03-18T18:25:30.673256+0000","last_clean":"2024-03-18T18:25:30.673256+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:25:30.673256+0000","last_undegraded":"2024-03-18T18:25:30.673256+0000","last_fullsized":"2024-03-18T18:25:30.673256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3918,"log_dups_size":0,"ondisk_log_size":3918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.38","version":"54'3528","reported_seq":2938,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986528+0000","last_change":"2024-03-18T18:25:29.224146+0000","last_active":"2024-03-18T18:25:32.986528+0000","last_peered":"2024-03-18T18:25:32.986528+0000","last_clean":"2024-03-18T18:25:32.986528+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:25:32.986528+0000","last_undegraded":"2024-03-18T18:25:32.986528+0000","last_fullsized":"2024-03-18T18:25:32.986528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:28:08.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.37","version":"54'3888","reported_seq":3242,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.666631+0000","last_change":"2024-03-18T18:25:29.056418+0000","last_active":"2024-03-18T18:25:30.666631+0000","last_peered":"2024-03-18T18:25:30.666631+0000","last_clean":"2024-03-18T18:25:30.666631+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:25:30.666631+0000","last_undegraded":"2024-03-18T18:25:30.666631+0000","last_fullsized":"2024-03-18T18:25:30.666631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.36","version":"54'3823","reported_seq":3237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.476053+0000","last_change":"2024-03-18T18:25:29.022953+0000","last_active":"2024-03-18T18:25:30.476053+0000","last_peered":"2024-03-18T18:25:30.476053+0000","last_clean":"2024-03-18T18:25:30.476053+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:25:30.476053+0000","last_undegraded":"2024-03-18T18:25:30.476053+0000","last_fullsized":"2024-03-18T18:25:30.476053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3823,"log_dups_size":0,"ondisk_log_size":3823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.35","version":"54'3532","reported_seq":2954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.445010+0000","last_change":"2024-03-18T18:25:29.017560+0000","last_active":"2024-03-18T18:25:30.445010+0000","last_peered":"2024-03-18T18:25:30.445010+0000","last_clean":"2024-03-18T18:25:30.445010+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:25:30.445010+0000","last_undegraded":"2024-03-18T18:25:30.445010+0000","last_fullsized":"2024-03-18T18:25:30.445010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.34","version":"54'4119","reported_seq":3410,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.503175+0000","last_change":"2024-03-18T18:25:29.195788+0000","last_active":"2024-03-18T18:25:30.503175+0000","last_peered":"2024-03-18T18:25:30.503175+0000","last_clean":"2024-03-18T18:25:30.503175+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:30.503175+0000","last_undegraded":"2024-03-18T18:25:30.503175+0000","last_fullsized":"2024-03-18T18:25:30.503175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.33","version":"54'3608","reported_seq":3014,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184078+0000","last_change":"2024-03-18T18:25:29.043841+0000","last_active":"2024-03-18T18:25:33.184078+0000","last_peered":"2024-03-18T18:25:33.184078+0000","last_clean":"2024-03-18T18:25:33.184078+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:25:33.184078+0000","last_undegraded":"2024-03-18T18:25:33.184078+0000","last_fullsized":"2024-03-18T18:25:33.184078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.32","version":"54'3871","reported_seq":3170,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798177+0000","last_change":"2024-03-18T18:25:29.047066+0000","last_active":"2024-03-18T18:25:32.798177+0000","last_peered":"2024-03-18T18:25:32.798177+0000","last_clean":"2024-03-18T18:25:32.798177+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:32.798177+0000","last_undegraded":"2024-03-18T18:25:32.798177+0000","last_fullsized":"2024-03-18T18:25:32.798177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.31","version":"54'3829","reported_seq":3152,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746701+0000","last_change":"2024-03-18T18:25:29.032597+0000","last_active":"2024-03-18T18:25:32.746701+0000","last_peered":"2024-03-18T18:25:32.746701+0000","last_clean":"2024-03-18T18:25:32.746701+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:25:32.746701+0000","last_undegraded":"2024-03-18T18:25:32.746701+0000","last_fullsized":"2024-03-18T18:25:32.746701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.30","version":"54'4022","reported_seq":3326,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.626154+0000","last_change":"2024-03-18T18:25:29.024791+0000","last_active":"2024-03-18T18:25:30.626154+0000","last_peered":"2024-03-18T18:25:30.626154+0000","last_clean":"2024-03-18T18:25:30.626154+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:25:30.626154+0000","last_undegraded":"2024-03-18T18:25:30.626154+0000","last_fullsized":"2024-03-18T18:25:30.626154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2f","version":"54'3787","reported_seq":3090,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.407396+0000","last_change":"2024-03-18T18:25:29.030461+0000","last_active":"2024-03-18T18:25:30.407396+0000","last_peered":"2024-03-18T18:25:30.407396+0000","last_clean":"2024-03-18T18:25:30.407396+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:25:30.407396+0000","last_undegraded":"2024-03-18T18:25:30.407396+0000","last_fullsized":"2024-03-18T18:25:30.407396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2e","version":"54'3740","reported_seq":3141,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986900+0000","last_change":"2024-03-18T18:25:29.221387+0000","last_active":"2024-03-18T18:25:32.986900+0000","last_peered":"2024-03-18T18:25:32.986900+0000","last_clean":"2024-03-18T18:25:32.986900+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:32.986900+0000","last_undegraded":"2024-03-18T18:25:32.986900+0000","last_fullsized":"2024-03-18T18:25:32.986900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.2d","version":"54'3972","reported_seq":3270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.677987+0000","last_change":"2024-03-18T18:25:29.055765+0000","last_active":"2024-03-18T18:25:30.677987+0000","last_peered":"2024-03-18T18:25:30.677987+0000","last_clean":"2024-03-18T18:25:30.677987+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:25:30.677987+0000","last_undegraded":"2024-03-18T18:25:30.677987+0000","last_fullsized":"2024-03-18T18:25:30.677987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2c","version":"54'3755","reported_seq":3109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.642916+0000","last_change":"2024-03-18T18:25:29.019398+0000","last_active":"2024-03-18T18:25:30.642916+0000","last_peered":"2024-03-18T18:25:30.642916+0000","last_clean":"2024-03-18T18:25:30.642916+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:25:30.642916+0000","last_undegraded":"2024-03-18T18:25:30.642916+0000","last_fullsized":"2024-03-18T18:25:30.642916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2b","version":"54'3495","reported_seq":2913,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798768+0000","last_change":"2024-03-18T18:25:29.059001+0000","last_active":"2024-03-18T18:25:32.798768+0000","last_peered":"2024-03-18T18:25:32.798768+0000","last_clean":"2024-03-18T18:25:32.798768+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:25:32.798768+0000","last_undegraded":"2024-03-18T18:25:32.798768+0000","last_fullsized":"2024-03-18T18:25:32.798768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.2a","version":"54'4356","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.716732+0000","last_change":"2024-03-18T18:25:29.035858+0000","last_active":"2024-03-18T18:25:30.716732+0000","last_peered":"2024-03-18T18:25:30.716732+0000","last_clean":"2024-03-18T18:25:30.716732+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:25:30.716732+0000","last_undegraded":"2024-03-18T18:25:30.716732+0000","last_fullsized":"2024-03-18T18:25:30.716732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4356,"log_dups_size":0,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.29","version":"54'3901","reported_seq":3232,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183300+0000","last_change":"2024-03-18T18:25:29.040440+0000","last_active":"2024-03-18T18:25:33.183300+0000","last_peered":"2024-03-18T18:25:33.183300+0000","last_clean":"2024-03-18T18:25:33.183300+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:25:33.183300+0000","last_undegraded":"2024-03-18T18:25:33.183300+0000","last_fullsized":"2024-03-18T18:25:33.183300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.28","version":"54'4190","reported_seq":3406,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.714777+0000","last_change":"2024-03-18T18:25:29.027847+0000","last_active":"2024-03-18T18:25:30.714777+0000","last_peered":"2024-03-18T18:25:30.714777+0000","last_clean":"2024-03-18T18:25:30.714777+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:25:30.714777+0000","last_undegraded":"2024-03-18T18:25:30.714777+0000","last_fullsized":"2024-03-18T18:25:30.714777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.27","version":"54'3282","reported_seq":2723,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184191+0000","last_change":"2024-03-18T18:25:29.043669+0000","last_active":"2024-03-18T18:25:33.184191+0000","last_peered":"2024-03-18T18:25:33.184191+0000","last_clean":"2024-03-18T18:25:33.184191+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:25:33.184191+0000","last_undegraded":"2024-03-18T18:25:33.184191+0000","last_fullsized":"2024-03-18T18:25:33.184191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.26","version":"54'3776","reported_seq":3134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.457472+0000","last_change":"2024-03-18T18:25:29.022945+0000","last_active":"2024-03-18T18:25:30.457472+0000","last_peered":"2024-03-18T18:25:30.457472+0000","last_clean":"2024-03-18T18:25:30.457472+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:25:30.457472+0000","last_undegraded":"2024-03-18T18:25:30.457472+0000","last_fullsized":"2024-03-18T18:25:30.457472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.25","version":"54'3857","reported_seq":3173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746541+0000","last_change":"2024-03-18T18:25:29.046199+0000","last_active":"2024-03-18T18:25:32.746541+0000","last_peered":"2024-03-18T18:25:32.746541+0000","last_clean":"2024-03-18T18:25:32.746541+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:25:32.746541+0000","last_undegraded":"2024-03-18T18:25:32.746541+0000","last_fullsized":"2024-03-18T18:25:32.746541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3857,"log_dups_size":0,"ondisk_log_size":3857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.24","version":"54'3360","reported_seq":2802,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.185162+0000","last_change":"2024-03-18T18:25:29.046208+0000","last_active":"2024-03-18T18:25:33.185162+0000","last_peered":"2024-03-18T18:25:33.185162+0000","last_clean":"2024-03-18T18:25:33.185162+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:25:33.185162+0000","last_undegraded":"2024-03-18T18:25:33.185162+0000","last_fullsized":"2024-03-18T18:25:33.185162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.23","version":"54'3862","reported_seq":3200,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798386+0000","last_change":"2024-03-18T18:25:29.058196+0000","last_active":"2024-03-18T18:25:32.798386+0000","last_peered":"2024-03-18T18:25:32.798386+0000","last_clean":"2024-03-18T18:25:32.798386+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:25:32.798386+0000","last_undegraded":"2024-03-18T18:25:32.798386+0000","last_fullsized":"2024-03-18T18:25:32.798386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.22","version":"54'3274","reported_seq":2720,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.711595+0000","last_change":"2024-03-18T18:25:29.038378+0000","last_active":"2024-03-18T18:25:30.711595+0000","last_peered":"2024-03-18T18:25:30.711595+0000","last_clean":"2024-03-18T18:25:30.711595+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:25:30.711595+0000","last_undegraded":"2024-03-18T18:25:30.711595+0000","last_fullsized":"2024-03-18T18:25:30.711595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.21","version":"54'4260","reported_seq":3501,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986680+0000","last_change":"2024-03-18T18:25:29.230579+0000","last_active":"2024-03-18T18:25:32.986680+0000","last_peered":"2024-03-18T18:25:32.986680+0000","last_clean":"2024-03-18T18:25:32.986680+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:32.986680+0000","last_undegraded":"2024-03-18T18:25:32.986680+0000","last_fullsized":"2024-03-18T18:25:32.986680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4260,"log_dups_size":0,"ondisk_log_size":4260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.20","version":"54'3981","reported_seq":3267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629516+0000","last_change":"2024-03-18T18:25:29.022937+0000","last_active":"2024-03-18T18:25:30.629516+0000","last_peered":"2024-03-18T18:25:30.629516+0000","last_clean":"2024-03-18T18:25:30.629516+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:25:30.629516+0000","last_undegraded":"2024-03-18T18:25:30.629516+0000","last_fullsized":"2024-03-18T18:25:30.629516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":3,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"54'4040","reported_seq":3306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.631280+0000","last_change":"2024-03-18T18:25:29.190915+0000","last_active":"2024-03-18T18:25:30.631280+0000","last_peered":"2024-03-18T18:25:30.631280+0000","last_clean":"2024-03-18T18:25:30.631280+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:30.631280+0000","last_undegraded":"2024-03-18T18:25:30.631280+0000","last_fullsized":"2024-03-18T18:25:30.631280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4040,"log_dups_size":0,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1b","version":"48'1439","reported_seq":1489,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.031560+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:25:29.031560+0000","last_peered":"2024-03-18T18:25:29.031560+0000","last_clean":"2024-03-18T18:25:29.031560+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:29.031560+0000","last_undegraded":"2024-03-18T18:25:29.031560+0000","last_fullsized":"2024-03-18T18:25:29.031560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2981,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798690+0000","last_change":"2024-03-18T18:25:29.062033+0000","last_active":"2024-03-18T18:25:32.798690+0000","last_peered":"2024-03-18T18:25:32.798690+0000","last_clean":"2024-03-18T18:25:32.798690+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:32.798690+0000","last_undegraded":"2024-03-18T18:25:32.798690+0000","last_fullsized":"2024-03-18T18:25:32.798690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1a","version":"54'3527","reported_seq":3576,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.999798+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:25:28.999798+0000","last_peered":"2024-03-18T18:25:28.999798+0000","last_clean":"2024-03-18T18:25:28.999798+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:28.999798+0000","last_undegraded":"2024-03-18T18:25:28.999798+0000","last_fullsized":"2024-03-18T18:25:28.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"50'679","reported_seq":729,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.028140+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:25:29.028140+0000","last_peered":"2024-03-18T18:25:29.028140+0000","last_clean":"2024-03-18T18:25:29.028140+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:29.028140+0000","last_undegraded":"2024-03-18T18:25:29.028140+0000","last_fullsized":"2024-03-18T18:25:29.028140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"54'4461","reported_seq":3633,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.182868+0000","last_change":"2024-03-18T18:25:29.040660+0000","last_active":"2024-03-18T18:25:33.182868+0000","last_peered":"2024-03-18T18:25:33.182868+0000","last_clean":"2024-03-18T18:25:33.182868+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:25:33.182868+0000","last_undegraded":"2024-03-18T18:25:33.182868+0000","last_fullsized":"2024-03-18T18:25:33.182868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.18","version":"50'5546","reported_seq":5595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.995891+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:25:27.995891+0000","last_peered":"2024-03-18T18:25:27.995891+0000","last_clean":"2024-03-18T18:25:27.995891+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:27.995891+0000","last_undegraded":"2024-03-18T18:25:27.995891+0000","last_fullsized":"2024-03-18T18:25:27.995891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5546,"log_dups_size":0,"ondisk_log_size":5546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"54'3911","reported_seq":3234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.747326+0000","last_change":"2024-03-18T18:25:29.032708+0000","last_active":"2024-03-18T18:25:32.747326+0000","last_peered":"2024-03-18T18:25:32.747326+0000","last_clean":"2024-03-18T18:25:32.747326+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:25:32.747326+0000","last_undegraded":"2024-03-18T18:25:32.747326+0000","last_fullsized":"2024-03-18T18:25:32.747326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.17","version":"54'1835","reported_seq":1884,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.551150+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:25:30.551150+0000","last_peered":"2024-03-18T18:25:30.551150+0000","last_clean":"2024-03-18T18:25:30.551150+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:30.551150+0000","last_undegraded":"2024-03-18T18:25:30.551150+0000","last_fullsized":"2024-03-18T18:25:30.551150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17202751,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1942,"num_write_kb":18495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"54'3669","reported_seq":3075,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.660214+0000","last_change":"2024-03-18T18:25:29.027139+0000","last_active":"2024-03-18T18:25:30.660214+0000","last_peered":"2024-03-18T18:25:30.660214+0000","last_clean":"2024-03-18T18:25:30.660214+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:25:30.660214+0000","last_undegraded":"2024-03-18T18:25:30.660214+0000","last_fullsized":"2024-03-18T18:25:30.660214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.16","version":"50'2293","reported_seq":2342,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.997045+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:25:27.997045+0000","last_peered":"2024-03-18T18:25:27.997045+0000","last_clean":"2024-03-18T18:25:27.997045+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:27.997045+0000","last_undegraded":"2024-03-18T18:25:27.997045+0000","last_fullsized":"2024-03-18T18:25:27.997045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"54'3704","reported_seq":3070,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.800565+0000","last_change":"2024-03-18T18:25:29.055272+0000","last_active":"2024-03-18T18:25:32.800565+0000","last_peered":"2024-03-18T18:25:32.800565+0000","last_clean":"2024-03-18T18:25:32.800565+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:32.800565+0000","last_undegraded":"2024-03-18T18:25:32.800565+0000","last_fullsized":"2024-03-18T18:25:32.800565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.15","version":"54'2695","reported_seq":2745,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.310867+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:25:31.310867+0000","last_peered":"2024-03-18T18:25:31.310867+0000","last_clean":"2024-03-18T18:25:31.310867+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:25:31.310867+0000","last_undegraded":"2024-03-18T18:25:31.310867+0000","last_fullsized":"2024-03-18T18:25:31.310867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"54'3872","reported_seq":3229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.627683+0000","last_change":"2024-03-18T18:25:29.195869+0000","last_active":"2024-03-18T18:25:30.627683+0000","last_peered":"2024-03-18T18:25:30.627683+0000","last_clean":"2024-03-18T18:25:30.627683+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:30.627683+0000","last_undegraded":"2024-03-18T18:25:30.627683+0000","last_fullsized":"2024-03-18T18:25:30.627683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.14","version":"50'3867","reported_seq":3916,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.105272+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:25:28.105272+0000","last_peered":"2024-03-18T18:25:28.105272+0000","last_clean":"2024-03-18T18:25:28.105272+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:28.105272+0000","last_undegraded":"2024-03-18T18:25:28.105272+0000","last_fullsized":"2024-03-18T18:25:28.105272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3867,"log_dups_size":0,"ondisk_log_size":3867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3978,"num_write_kb":30874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"54'3911","reported_seq":3206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.666167+0000","last_change":"2024-03-18T18:25:29.054617+0000","last_active":"2024-03-18T18:25:30.666167+0000","last_peered":"2024-03-18T18:25:30.666167+0000","last_clean":"2024-03-18T18:25:30.666167+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:25:30.666167+0000","last_undegraded":"2024-03-18T18:25:30.666167+0000","last_fullsized":"2024-03-18T18:25:30.666167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.13","version":"50'2794","reported_seq":2845,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799151+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:25:32.799151+0000","last_peered":"2024-03-18T18:25:32.799151+0000","last_clean":"2024-03-18T18:25:32.799151+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:32.799151+0000","last_undegraded":"2024-03-18T18:25:32.799151+0000","last_fullsized":"2024-03-18T18:25:32.799151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2794,"log_dups_size":0,"ondisk_log_size":2794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"54'3870","reported_seq":3181,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798503+0000","last_change":"2024-03-18T18:25:29.049751+0000","last_active":"2024-03-18T18:25:32.798503+0000","last_peered":"2024-03-18T18:25:32.798503+0000","last_clean":"2024-03-18T18:25:32.798503+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:32.798503+0000","last_undegraded":"2024-03-18T18:25:32.798503+0000","last_fullsized":"2024-03-18T18:25:32.798503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.12","version":"54'148","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.004884+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:25:29.004884+0000","last_peered":"2024-03-18T18:25:29.004884+0000","last_clean":"2024-03-18T18:25:29.004884+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:25:29.004884+0000","last_undegraded":"2024-03-18T18:25:29.004884+0000","last_fullsized":"2024-03-18T18:25:29.004884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3403,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.641498+0000","last_change":"2024-03-18T18:25:29.053722+0000","last_active":"2024-03-18T18:25:30.641498+0000","last_peered":"2024-03-18T18:25:30.641498+0000","last_clean":"2024-03-18T18:25:30.641498+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:25:30.641498+0000","last_undegraded":"2024-03-18T18:25:30.641498+0000","last_fullsized":"2024-03-18T18:25:30.641498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.11","version":"48'1126","reported_seq":1175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.104928+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:25:28.104928+0000","last_peered":"2024-03-18T18:25:28.104928+0000","last_clean":"2024-03-18T18:25:28.104928+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:28.104928+0000","last_undegraded":"2024-03-18T18:25:28.104928+0000","last_fullsized":"2024-03-18T18:25:28.104928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"54'3648","reported_seq":2965,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629417+0000","last_change":"2024-03-18T18:25:29.016810+0000","last_active":"2024-03-18T18:25:30.629417+0000","last_peered":"2024-03-18T18:25:30.629417+0000","last_clean":"2024-03-18T18:25:30.629417+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:25:30.629417+0000","last_undegraded":"2024-03-18T18:25:30.629417+0000","last_fullsized":"2024-03-18T18:25:30.629417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3648,"log_dups_size":0,"ondisk_log_size":3648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.10","version":"54'1551","reported_seq":1602,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986702+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:25:32.986702+0000","last_peered":"2024-03-18T18:25:32.986702+0000","last_clean":"2024-03-18T18:25:32.986702+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:32.986702+0000","last_undegraded":"2024-03-18T18:25:32.986702+0000","last_fullsized":"2024-03-18T18:25:32.986702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"54'4132","reported_seq":3360,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.676821+0000","last_change":"2024-03-18T18:25:29.051925+0000","last_active":"2024-03-18T18:25:30.676821+0000","last_peered":"2024-03-18T18:25:30.676821+0000","last_clean":"2024-03-18T18:25:30.676821+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:25:30.676821+0000","last_undegraded":"2024-03-18T18:25:30.676821+0000","last_fullsized":"2024-03-18T18:25:30.676821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4132,"log_dups_size":0,"ondisk_log_size":4132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.f","version":"48'1388","reported_seq":1438,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.108197+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:25:28.108197+0000","last_peered":"2024-03-18T18:25:28.108197+0000","last_clean":"2024-03-18T18:25:28.108197+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:28.108197+0000","last_undegraded":"2024-03-18T18:25:28.108197+0000","last_fullsized":"2024-03-18T18:25:28.108197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"54'3700","reported_seq":3040,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.660977+0000","last_change":"2024-03-18T18:25:29.056125+0000","last_active":"2024-03-18T18:25:30.660977+0000","last_peered":"2024-03-18T18:25:30.660977+0000","last_clean":"2024-03-18T18:25:30.660977+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:30.660977+0000","last_undegraded":"2024-03-18T18:25:30.660977+0000","last_fullsized":"2024-03-18T18:25:30.660977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.e","version":"50'1377","reported_seq":1428,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.205286+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:25:29.205286+0000","last_peered":"2024-03-18T18:25:29.205286+0000","last_clean":"2024-03-18T18:25:29.205286+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:29.205286+0000","last_undegraded":"2024-03-18T18:25:29.205286+0000","last_fullsized":"2024-03-18T18:25:29.205286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"54'4065","reported_seq":3351,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.987166+0000","last_change":"2024-03-18T18:25:29.226986+0000","last_active":"2024-03-18T18:25:32.987166+0000","last_peered":"2024-03-18T18:25:32.987166+0000","last_clean":"2024-03-18T18:25:32.987166+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:25:32.987166+0000","last_undegraded":"2024-03-18T18:25:32.987166+0000","last_fullsized":"2024-03-18T18:25:32.987166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4065,"log_dups_size":0,"ondisk_log_size":4065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:22:20.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.d","version":"50'4629","reported_seq":4680,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.998187+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:25:28.998187+0000","last_peered":"2024-03-18T18:25:28.998187+0000","last_clean":"2024-03-18T18:25:28.998187+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:28.998187+0000","last_undegraded":"2024-03-18T18:25:28.998187+0000","last_fullsized":"2024-03-18T18:25:28.998187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3738","reported_seq":3058,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.703287+0000","last_change":"2024-03-18T18:25:29.033548+0000","last_active":"2024-03-18T18:25:30.703287+0000","last_peered":"2024-03-18T18:25:30.703287+0000","last_clean":"2024-03-18T18:25:30.703287+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:25:30.703287+0000","last_undegraded":"2024-03-18T18:25:30.703287+0000","last_fullsized":"2024-03-18T18:25:30.703287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3738,"log_dups_size":0,"ondisk_log_size":3738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.c","version":"48'5034","reported_seq":5085,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.205485+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:25:29.205485+0000","last_peered":"2024-03-18T18:25:29.205485+0000","last_clean":"2024-03-18T18:25:29.205485+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:29.205485+0000","last_undegraded":"2024-03-18T18:25:29.205485+0000","last_fullsized":"2024-03-18T18:25:29.205485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5034,"log_dups_size":0,"ondisk_log_size":5034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'3518","reported_seq":2894,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.676401+0000","last_change":"2024-03-18T18:25:29.055382+0000","last_active":"2024-03-18T18:25:30.676401+0000","last_peered":"2024-03-18T18:25:30.676401+0000","last_clean":"2024-03-18T18:25:30.676401+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:25:30.676401+0000","last_undegraded":"2024-03-18T18:25:30.676401+0000","last_fullsized":"2024-03-18T18:25:30.676401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3518,"log_dups_size":0,"ondisk_log_size":3518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:00.566254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.103195+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:25:28.103195+0000","last_peered":"2024-03-18T18:25:28.103195+0000","last_clean":"2024-03-18T18:25:28.103195+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:28.103195+0000","last_undegraded":"2024-03-18T18:25:28.103195+0000","last_fullsized":"2024-03-18T18:25:28.103195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"50'1920","reported_seq":1970,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.996090+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:25:27.996090+0000","last_peered":"2024-03-18T18:25:27.996090+0000","last_clean":"2024-03-18T18:25:27.996090+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:27.996090+0000","last_undegraded":"2024-03-18T18:25:27.996090+0000","last_fullsized":"2024-03-18T18:25:27.996090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184197+0000","last_change":"2024-03-18T18:25:29.046186+0000","last_active":"2024-03-18T18:25:33.184197+0000","last_peered":"2024-03-18T18:25:33.184197+0000","last_clean":"2024-03-18T18:25:33.184197+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:33.184197+0000","last_undegraded":"2024-03-18T18:25:33.184197+0000","last_fullsized":"2024-03-18T18:25:33.184197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.0","version":"50'4975","reported_seq":5026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.103154+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:25:28.103154+0000","last_peered":"2024-03-18T18:25:28.103154+0000","last_clean":"2024-03-18T18:25:28.103154+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:28.103154+0000","last_undegraded":"2024-03-18T18:25:28.103154+0000","last_fullsized":"2024-03-18T18:25:28.103154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4975,"log_dups_size":0,"ondisk_log_size":4975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2932,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.797905+0000","last_change":"2024-03-18T18:25:29.042446+0000","last_active":"2024-03-18T18:25:32.797905+0000","last_peered":"2024-03-18T18:25:32.797905+0000","last_clean":"2024-03-18T18:25:32.797905+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:32.797905+0000","last_undegraded":"2024-03-18T18:25:32.797905+0000","last_fullsized":"2024-03-18T18:25:32.797905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1","version":"54'2669","reported_seq":3260,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.301894+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:25:31.301894+0000","last_peered":"2024-03-18T18:25:31.301894+0000","last_clean":"2024-03-18T18:25:31.301894+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:31.301894+0000","last_undegraded":"2024-03-18T18:25:31.301894+0000","last_fullsized":"2024-03-18T18:25:31.301894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"54'4235","reported_seq":3482,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746406+0000","last_change":"2024-03-18T18:25:29.032416+0000","last_active":"2024-03-18T18:25:32.746406+0000","last_peered":"2024-03-18T18:25:32.746406+0000","last_clean":"2024-03-18T18:25:32.746406+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:25:32.746406+0000","last_undegraded":"2024-03-18T18:25:32.746406+0000","last_fullsized":"2024-03-18T18:25:32.746406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4235,"log_dups_size":0,"ondisk_log_size":4235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.2","version":"50'5920","reported_seq":5970,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.996813+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:25:27.996813+0000","last_peered":"2024-03-18T18:25:27.996813+0000","last_clean":"2024-03-18T18:25:27.996813+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:27.996813+0000","last_undegraded":"2024-03-18T18:25:27.996813+0000","last_fullsized":"2024-03-18T18:25:27.996813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5920,"log_dups_size":0,"ondisk_log_size":5920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3974","reported_seq":3243,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.620681+0000","last_change":"2024-03-18T18:25:29.192820+0000","last_active":"2024-03-18T18:25:30.620681+0000","last_peered":"2024-03-18T18:25:30.620681+0000","last_clean":"2024-03-18T18:25:30.620681+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:30.620681+0000","last_undegraded":"2024-03-18T18:25:30.620681+0000","last_fullsized":"2024-03-18T18:25:30.620681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.4","version":"54'954","reported_seq":1005,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.299607+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:25:31.299607+0000","last_peered":"2024-03-18T18:25:31.299607+0000","last_clean":"2024-03-18T18:25:31.299607+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:31.299607+0000","last_undegraded":"2024-03-18T18:25:31.299607+0000","last_fullsized":"2024-03-18T18:25:31.299607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"54'3615","reported_seq":3002,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.690582+0000","last_change":"2024-03-18T18:25:29.037811+0000","last_active":"2024-03-18T18:25:30.690582+0000","last_peered":"2024-03-18T18:25:30.690582+0000","last_clean":"2024-03-18T18:25:30.690582+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:25:30.690582+0000","last_undegraded":"2024-03-18T18:25:30.690582+0000","last_fullsized":"2024-03-18T18:25:30.690582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.5","version":"48'3704","reported_seq":3754,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106822+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:25:28.106822+0000","last_peered":"2024-03-18T18:25:28.106822+0000","last_clean":"2024-03-18T18:25:28.106822+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:25:28.106822+0000","last_undegraded":"2024-03-18T18:25:28.106822+0000","last_fullsized":"2024-03-18T18:25:28.106822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3185,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746463+0000","last_change":"2024-03-18T18:25:29.039953+0000","last_active":"2024-03-18T18:25:32.746463+0000","last_peered":"2024-03-18T18:25:32.746463+0000","last_clean":"2024-03-18T18:25:32.746463+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:25:32.746463+0000","last_undegraded":"2024-03-18T18:25:32.746463+0000","last_fullsized":"2024-03-18T18:25:32.746463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.6","version":"54'2145","reported_seq":2196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.011889+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:25:31.011889+0000","last_peered":"2024-03-18T18:25:31.011889+0000","last_clean":"2024-03-18T18:25:31.011889+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:31.011889+0000","last_undegraded":"2024-03-18T18:25:31.011889+0000","last_fullsized":"2024-03-18T18:25:31.011889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2145,"log_dups_size":0,"ondisk_log_size":2145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2812,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184726+0000","last_change":"2024-03-18T18:25:29.044961+0000","last_active":"2024-03-18T18:25:33.184726+0000","last_peered":"2024-03-18T18:25:33.184726+0000","last_clean":"2024-03-18T18:25:33.184726+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:25:33.184726+0000","last_undegraded":"2024-03-18T18:25:33.184726+0000","last_fullsized":"2024-03-18T18:25:33.184726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.7","version":"50'1819","reported_seq":1869,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106751+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:25:28.106751+0000","last_peered":"2024-03-18T18:25:28.106751+0000","last_clean":"2024-03-18T18:25:28.106751+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:28.106751+0000","last_undegraded":"2024-03-18T18:25:28.106751+0000","last_fullsized":"2024-03-18T18:25:28.106751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1819,"log_dups_size":0,"ondisk_log_size":1819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'3540","reported_seq":2943,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799415+0000","last_change":"2024-03-18T18:25:29.063216+0000","last_active":"2024-03-18T18:25:32.799415+0000","last_peered":"2024-03-18T18:25:32.799415+0000","last_clean":"2024-03-18T18:25:32.799415+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:32.799415+0000","last_undegraded":"2024-03-18T18:25:32.799415+0000","last_fullsized":"2024-03-18T18:25:32.799415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.8","version":"48'1602","reported_seq":1652,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.102909+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:25:28.102909+0000","last_peered":"2024-03-18T18:25:28.102909+0000","last_clean":"2024-03-18T18:25:28.102909+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:25:28.102909+0000","last_undegraded":"2024-03-18T18:25:28.102909+0000","last_fullsized":"2024-03-18T18:25:28.102909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1602,"log_dups_size":0,"ondisk_log_size":1602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"54'3735","reported_seq":3026,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.477612+0000","last_change":"2024-03-18T18:25:29.194592+0000","last_active":"2024-03-18T18:25:30.477612+0000","last_peered":"2024-03-18T18:25:30.477612+0000","last_clean":"2024-03-18T18:25:30.477612+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:30.477612+0000","last_undegraded":"2024-03-18T18:25:30.477612+0000","last_fullsized":"2024-03-18T18:25:30.477612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3735,"log_dups_size":0,"ondisk_log_size":3735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.9","version":"50'2478","reported_seq":2529,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.997253+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:25:28.997253+0000","last_peered":"2024-03-18T18:25:28.997253+0000","last_clean":"2024-03-18T18:25:28.997253+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:28.997253+0000","last_undegraded":"2024-03-18T18:25:28.997253+0000","last_fullsized":"2024-03-18T18:25:28.997253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2478,"log_dups_size":0,"ondisk_log_size":2478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"54'3993","reported_seq":3320,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183031+0000","last_change":"2024-03-18T18:25:29.042734+0000","last_active":"2024-03-18T18:25:33.183031+0000","last_peered":"2024-03-18T18:25:33.183031+0000","last_clean":"2024-03-18T18:25:33.183031+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:33.183031+0000","last_undegraded":"2024-03-18T18:25:33.183031+0000","last_fullsized":"2024-03-18T18:25:33.183031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.a","version":"50'2622","reported_seq":2673,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.997606+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:25:28.997606+0000","last_peered":"2024-03-18T18:25:28.997606+0000","last_clean":"2024-03-18T18:25:28.997606+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:28.997606+0000","last_undegraded":"2024-03-18T18:25:28.997606+0000","last_fullsized":"2024-03-18T18:25:28.997606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2622,"log_dups_size":0,"ondisk_log_size":2622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'3488","reported_seq":2910,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184638+0000","last_change":"2024-03-18T18:25:29.044854+0000","last_active":"2024-03-18T18:25:33.184638+0000","last_peered":"2024-03-18T18:25:33.184638+0000","last_clean":"2024-03-18T18:25:33.184638+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:25:33.184638+0000","last_undegraded":"2024-03-18T18:25:33.184638+0000","last_fullsized":"2024-03-18T18:25:33.184638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.b","version":"48'4482","reported_seq":4532,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106243+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:25:28.106243+0000","last_peered":"2024-03-18T18:25:28.106243+0000","last_clean":"2024-03-18T18:25:28.106243+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:25:28.106243+0000","last_undegraded":"2024-03-18T18:25:28.106243+0000","last_fullsized":"2024-03-18T18:25:28.106243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4482,"log_dups_size":0,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"54'3776","reported_seq":3131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.598753+0000","last_change":"2024-03-18T18:25:29.014675+0000","last_active":"2024-03-18T18:25:30.598753+0000","last_peered":"2024-03-18T18:25:30.598753+0000","last_clean":"2024-03-18T18:25:30.598753+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:25:30.598753+0000","last_undegraded":"2024-03-18T18:25:30.598753+0000","last_fullsized":"2024-03-18T18:25:30.598753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"54'3708","reported_seq":3115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.700610+0000","last_change":"2024-03-18T18:25:29.035433+0000","last_active":"2024-03-18T18:25:30.700610+0000","last_peered":"2024-03-18T18:25:30.700610+0000","last_clean":"2024-03-18T18:25:30.700610+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:25:30.700610+0000","last_undegraded":"2024-03-18T18:25:30.700610+0000","last_fullsized":"2024-03-18T18:25:30.700610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3708,"log_dups_size":0,"ondisk_log_size":3708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":3,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1c","version":"51'1387","reported_seq":1436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.105343+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:25:28.105343+0000","last_peered":"2024-03-18T18:25:28.105343+0000","last_clean":"2024-03-18T18:25:28.105343+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:25:28.105343+0000","last_undegraded":"2024-03-18T18:25:28.105343+0000","last_fullsized":"2024-03-18T18:25:28.105343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4100","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.702015+0000","last_change":"2024-03-18T18:25:29.032671+0000","last_active":"2024-03-18T18:25:30.702015+0000","last_peered":"2024-03-18T18:25:30.702015+0000","last_clean":"2024-03-18T18:25:30.702015+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:25:30.702015+0000","last_undegraded":"2024-03-18T18:25:30.702015+0000","last_fullsized":"2024-03-18T18:25:30.702015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1d","version":"50'3529","reported_seq":3578,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106016+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:25:28.106016+0000","last_peered":"2024-03-18T18:25:28.106016+0000","last_clean":"2024-03-18T18:25:28.106016+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:25:28.106016+0000","last_undegraded":"2024-03-18T18:25:28.106016+0000","last_fullsized":"2024-03-18T18:25:28.106016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"54'3441","reported_seq":2892,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799819+0000","last_change":"2024-03-18T18:25:29.053757+0000","last_active":"2024-03-18T18:25:32.799819+0000","last_peered":"2024-03-18T18:25:32.799819+0000","last_clean":"2024-03-18T18:25:32.799819+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:25:32.799819+0000","last_undegraded":"2024-03-18T18:25:32.799819+0000","last_fullsized":"2024-03-18T18:25:32.799819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1e","version":"50'3382","reported_seq":3434,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.034174+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:25:29.034174+0000","last_peered":"2024-03-18T18:25:29.034174+0000","last_clean":"2024-03-18T18:25:29.034174+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:29.034174+0000","last_undegraded":"2024-03-18T18:25:29.034174+0000","last_fullsized":"2024-03-18T18:25:29.034174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"54'3368","reported_seq":2785,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184383+0000","last_change":"2024-03-18T18:25:29.047446+0000","last_active":"2024-03-18T18:25:33.184383+0000","last_peered":"2024-03-18T18:25:33.184383+0000","last_clean":"2024-03-18T18:25:33.184383+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:25:33.184383+0000","last_undegraded":"2024-03-18T18:25:33.184383+0000","last_fullsized":"2024-03-18T18:25:33.184383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1f","version":"50'1528","reported_seq":1579,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.006189+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:25:29.006189+0000","last_peered":"2024-03-18T18:25:29.006189+0000","last_clean":"2024-03-18T18:25:29.006189+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:29.006189+0000","last_undegraded":"2024-03-18T18:25:29.006189+0000","last_fullsized":"2024-03-18T18:25:29.006189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127205,"num_objects":128,"num_object_clones":28,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":13,"num_read":31,"num_read_kb":21,"num_write":75036,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":254396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241878,"ondisk_log_size":241878,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264160439,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88568,"num_write_kb":694604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384000,"data_stored":528320878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85044,"ondisk_log_size":85044,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476938,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404708,"kb_used_data":66780,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967132,"statfs":{"total":96636764160,"available":96222343168,"internally_reserved":0,"allocated":68382720,"data_stored":68015462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.628,"15min":0.69599999999999995},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.82099999999999995,"5min":1.119,"15min":5.4859999999999998},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83899999999999997,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.79400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.099,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.80800000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":1.05,"15min":1.5009999999999999},"last":1.113}]},{"osd":2,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.68600000000000005,"15min":0.755},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.3700000000000001},"last":0.996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78500000000000003,"15min":0.82499999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.135,"5min":1.655,"15min":5.452},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79200000000000004,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99099999999999999,"5min":1.5349999999999999,"15min":2.5859999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.69699999999999995,"15min":0.76000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":1.726,"15min":1.726},"last":1.079},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.78500000000000003,"15min":0.83199999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":1.0640000000000001,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.76700000000000002,"15min":0.88600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.171,"5min":1.4890000000000001,"15min":4.1150000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.85899999999999999,"15min":0.94799999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1479999999999999,"5min":1.6240000000000001,"15min":4.2350000000000003},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.90000000000000002,"15min":0.94399999999999995},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":2.0379999999999998,"5min":3.024,"15min":4.1840000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.85099999999999998,"15min":0.95399999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":3.1709999999999998,"15min":5.431},"last":1.0509999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366720,"kb_used_data":78904,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94005120,"statfs":{"total":96636764160,"available":96261242880,"internally_reserved":0,"allocated":80797696,"data_stored":80441792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.76200000000000001},"min":{"1min":0.28899999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1060000000000001,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91800000000000004,"15min":0.84099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.224,"5min":10.127000000000001,"15min":10.127000000000001},"last":1.073}]},{"osd":1,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95099999999999996,"15min":0.81999999999999995},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":12.565,"15min":12.565},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.087,"15min":0.88300000000000001},"min":{"1min":0.42199999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":16.579999999999998,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.995}]},{"osd":2,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.76400000000000001},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.6859999999999999,"5min":6.202,"15min":6.202},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.157,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.98799999999999999,"15min":0.90200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.1320000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.113,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.33500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.208,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.45000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.726,"5min":10.08,"15min":10.08},"last":1.1399999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.83199999999999996,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":27.231000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.054,"15min":1.113},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.351,"5min":9.2509999999999994,"15min":27.478999999999999},"last":1.046}]},{"osd":7,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.56999999999999995,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4570000000000001,"5min":10.182,"15min":10.182},"last":1.206},{"interface":"front","average":{"1min":1.02,"5min":0.86099999999999999,"15min":0.95499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.474,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.103}]}]},{"osd":5,"up_from":16,"seq":68719476938,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513464,"kb_used_data":103344,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93858376,"statfs":{"total":96636764160,"available":96110977024,"internally_reserved":0,"allocated":105824256,"data_stored":105454885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":2.073,"5min":2.073,"15min":3.6739999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.7150000000000001,"5min":0.874,"15min":0.80800000000000005},"min":{"1min":0.57399999999999995,"5min":0.255,"15min":0.255},"max":{"1min":20.013000000000002,"5min":20.013000000000002,"15min":20.013000000000002},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":7.2469999999999999,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.3160000000000001,"5min":0.85799999999999998,"15min":0.83199999999999996},"min":{"1min":0.48199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.231,"5min":10.231,"15min":10.231},"last":0.75}]},{"osd":2,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":0.876,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.041,"5min":12.041,"15min":12.041},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.317,"15min":0.317},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":0.999,"15min":0.92600000000000005},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":16.183,"5min":16.183,"15min":16.183},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.125,"5min":0.89000000000000001,"15min":0.97199999999999998},"min":{"1min":0.61799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":13.678000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.71499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.85799999999999998,"15min":0.90300000000000002},"min":{"1min":0.74399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":0.94599999999999995}]},{"osd":6,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.89000000000000001,"15min":0.93200000000000005},"min":{"1min":0.66300000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.89000000000000001,"15min":0.94499999999999995},"min":{"1min":0.64800000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.0860000000000001,"15min":1.0549999999999999},"min":{"1min":0.63500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.766,"5min":12.766,"15min":12.766},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.091,"15min":1.083},"min":{"1min":0.77700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":12.788,"5min":12.788,"15min":12.788},"last":1.03}]}]},{"osd":4,"up_from":16,"seq":68719476936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422104,"kb_used_data":53900,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":93949736,"statfs":{"total":96636764160,"available":96204529664,"internally_reserved":0,"allocated":55193600,"data_stored":54833645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.8109999999999999,"5min":2.536,"15min":2.536},"last":0.88},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.64500000000000002,"15min":0.69899999999999995},"min":{"1min":0.252,"5min":0.251,"15min":0.251},"max":{"1min":0.81200000000000006,"5min":1.335,"15min":1.946},"last":0.73599999999999999}]},{"osd":1,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.93400000000000005,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.73599999999999999,"15min":0.80400000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.1970000000000001,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.80600000000000005,"15min":0.84899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.046}]},{"osd":3,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.81699999999999995},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.877,"15min":0.89600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.012,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.77800000000000002,"15min":0.84999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":2.613,"15min":4.7119999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.80500000000000005,"15min":0.89000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0609999999999999,"5min":1.393,"15min":4.7480000000000002},"last":0.84899999999999998}]},{"osd":6,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.85699999999999998,"15min":0.91100000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4770000000000001,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.88700000000000001,"15min":0.96099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.2190000000000001,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.84899999999999998,"15min":0.93700000000000006},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.141,"5min":1.3979999999999999,"15min":3.96},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.96499999999999997,"15min":1.0269999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.1830000000000001,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.1040000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509642,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260828,"kb_used_data":45200,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111012,"statfs":{"total":96636764160,"available":96369676288,"internally_reserved":0,"allocated":46284800,"data_stored":45930721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.20499999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.65000000000000002,"15min":0.67700000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.4039999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90900000000000003,"5min":1.1759999999999999,"15min":1.3149999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.78600000000000003,"15min":0.76700000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0209999999999999,"5min":1.216,"15min":1.3},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":0.84899999999999998,"15min":0.78000000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.778,"5min":12.778,"15min":12.778},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":0.94399999999999995,"15min":0.82199999999999995},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":12.84,"5min":12.84,"15min":12.84},"last":0.71599999999999997}]},{"osd":4,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.82999999999999996,"15min":0.85599999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0760000000000001,"5min":1.526,"15min":1.526},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.99399999999999999,"15min":0.95999999999999996},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.9729999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.0920000000000001,"15min":1.0149999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":12.807,"5min":12.807,"15min":12.807},"last":1.169},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.1599999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":19.149000000000001,"5min":19.149000000000001,"15min":19.149000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.244,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.012},{"interface":"front","average":{"1min":0.83899999999999997,"5min":1.02,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.6859999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2030000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.052},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.0469999999999999,"15min":1.073},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.27,"5min":1.518,"15min":1.8320000000000001},"last":1.071}]}]},{"osd":1,"up_from":15,"seq":64424509642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410660,"kb_used_data":90776,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961180,"statfs":{"total":96636764160,"available":96216248320,"internally_reserved":0,"allocated":92954624,"data_stored":92588564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.1359999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.0189999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0620000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.80800000000000005},"min":{"1min":0.38100000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.0289999999999999,"5min":2.8170000000000002,"15min":4.069},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.88700000000000001,"15min":0.86399999999999999},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.339,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2130000000000001,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":1.0209999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0740000000000001},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.29,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.48699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.91600000000000004}]},{"osd":7,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.56000000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2370000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":4.1509999999999998,"5min":4.1509999999999998,"15min":4.798},"last":0.88200000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542346,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319144,"kb_used_data":49312,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052696,"statfs":{"total":96636764160,"available":96309960704,"internally_reserved":0,"allocated":50495488,"data_stored":50136006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.747},{"interface":"front","average":{"1min":1.1659999999999999,"5min":0.77800000000000002,"15min":0.71299999999999997},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":11.132,"5min":11.132,"15min":11.132},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.30199999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.421,"5min":1.857,"15min":3.3839999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.86399999999999999,"15min":0.78200000000000003},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.331,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.872,"15min":0.876},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.95999999999999996,"15min":0.94699999999999995},"min":{"1min":0.504,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":2.609,"15min":2.609},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":1.008},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.587,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.026}]},{"osd":6,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.6259999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.157,"15min":1.0860000000000001},"min":{"1min":0.54600000000000004,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":13.02,"5min":13.02,"15min":13.02},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":1.893,"15min":1.9139999999999999},"last":1.157}]}]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263656,"kb_used_data":34012,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108184,"statfs":{"total":96636764160,"available":96366780416,"internally_reserved":0,"allocated":34828288,"data_stored":34463059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.68000000000000005,"15min":0.621},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.0229999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.37,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.0140000000000002,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.441},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96599999999999997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.82199999999999995,"15min":0.77100000000000002},"min":{"1min":0.41199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.226,"5min":0.93000000000000005,"15min":0.85599999999999998},"min":{"1min":0.48399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.623}]},{"osd":4,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.66000000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.125,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.94899999999999995}]},{"osd":5,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0169999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":5.0650000000000004,"5min":14.869,"15min":14.869},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0880000000000001,"15min":1.022},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4870000000000001,"5min":14.804,"15min":14.804},"last":0.749}]},{"osd":6,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.157,"15min":1.0660000000000001},"min":{"1min":0.64300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.4049999999999994,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4259999999999999,"5min":2.113,"15min":2.113},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.455,"5min":11.455,"15min":11.455},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.294,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":11.430999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.1459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":105287680,"data_stored":105283225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80125952,"data_stored":80117983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":28709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":32854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:25:35.542 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T18:25:35.542 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:25:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.655+0000 7f679bfff700 1 Processor -- start 2024-03-18T18:25:35.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- start start 2024-03-18T18:25:35.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c0b1090 0x7f679c0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f679c0afcf0 0x7f679c14ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c1432a0 con 0x7f679c06cbc0 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679c13c980 con 0x7f679c0afcf0 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c06ea20 con 0x7f679c0b1090 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f679c0afcf0 0x7f679c14ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f679c0afcf0 0x7f679c14ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54680/0 (socket says 172.21.15.94:54680) 2024-03-18T18:25:35.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 -- 172.21.15.94:0/1598806194 learned_addr learned my addr 172.21.15.94:0/1598806194 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679a7fc700 1 --2- 172.21.15.94:0/1598806194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c0b1090 0x7f679c0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 -- 172.21.15.94:0/1598806194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c0b1090 msgr2=0x7f679c0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 --2- 172.21.15.94:0/1598806194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c0b1090 0x7f679c0af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 -- 172.21.15.94:0/1598806194 >> v1:172.21.15.151:6789/0 conn(0x7f679c06cbc0 legacy=0x7f679c142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 -- 172.21.15.94:0/1598806194 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c0b14f0 con 0x7f679c0afcf0 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679b7fe700 1 --2- 172.21.15.94:0/1598806194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c14ce00 secure :-1 s=READY pgs=4487 cs=0 l=1 rev1=1 crypto rx=0x7f6794009e50 tx=0x7f679400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614b7a0abf465294 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f6799ffb700 1 -- 172.21.15.94:0/1598806194 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400e070 con 0x7f679c0afcf0 2024-03-18T18:25:35.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f6799ffb700 1 -- 172.21.15.94:0/1598806194 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679400b910 con 0x7f679c0afcf0 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f6799ffb700 1 -- 172.21.15.94:0/1598806194 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679400bcc0 con 0x7f679c0afcf0 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- 172.21.15.94:0/1598806194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 msgr2=0x7f679c14ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 --2- 172.21.15.94:0/1598806194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c14ce00 secure :-1 s=READY pgs=4487 cs=0 l=1 rev1=1 crypto rx=0x7f6794009e50 tx=0x7f679400b330 comp rx=0 tx=0).stop 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- 172.21.15.94:0/1598806194 shutdown_connections 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 --2- 172.21.15.94:0/1598806194 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c14ce00 unknown :-1 s=CLOSED pgs=4487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 --2- 172.21.15.94:0/1598806194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c0b1090 0x7f679c0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- 172.21.15.94:0/1598806194 >> 172.21.15.94:0/1598806194 conn(0x7f679c0b7a20 msgr2=0x7f679c0b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:35.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- 172.21.15.94:0/1598806194 shutdown_connections 2024-03-18T18:25:35.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.659+0000 7f679bfff700 1 -- 172.21.15.94:0/1598806194 wait complete. 2024-03-18T18:25:35.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 Processor -- start 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 -- start start 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c06cbc0 0x7f679c13f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f679c0b1090 0x7f679c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1db3d0 con 0x7f679c0afcf0 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c13ee00 con 0x7f679c0b1090 2024-03-18T18:25:35.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c13d8b0 con 0x7f679c06cbc0 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c071400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54688/0 (socket says 172.21.15.94:54688) 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 -- 172.21.15.94:0/119287448 learned_addr learned my addr 172.21.15.94:0/119287448 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679affd700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c06cbc0 0x7f679c13f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679b7fe700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f679c0b1090 0x7f679c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 -- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c06cbc0 msgr2=0x7f679c13f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c06cbc0 0x7f679c13f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 -- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f679c0b1090 msgr2=0x7f679c071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f679c0b1090 0x7f679c071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 -- 172.21.15.94:0/119287448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794009b30 con 0x7f679c0afcf0 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679a7fc700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c071400 secure :-1 s=READY pgs=4488 cs=0 l=1 rev1=1 crypto rx=0x7f678c00e870 tx=0x7f678c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c0095c0 con 0x7f679c0afcf0 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c013680 con 0x7f679c0afcf0 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c13db90 con 0x7f679c0afcf0 2024-03-18T18:25:35.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c013a10 con 0x7f679c0afcf0 2024-03-18T18:25:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.663+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c13eb20 con 0x7f679c0afcf0 2024-03-18T18:25:35.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.667+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679c13f4d0 con 0x7f679c0afcf0 2024-03-18T18:25:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.667+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f678c013b90 con 0x7f679c0afcf0 2024-03-18T18:25:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.667+0000 7f67837fe700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6788066730 0x7f6788068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.667+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f678c0840b0 con 0x7f679c0afcf0 2024-03-18T18:25:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.667+0000 7f679affd700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6788066730 0x7f6788068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:35.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.667+0000 7f679affd700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6788066730 0x7f6788068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6790000f60 tx=0x7f6790009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:35.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.675+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f679c13f4d0 con 0x7f679c0afcf0 2024-03-18T18:25:35.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.839+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f679c13da20 con 0x7f6788066730 2024-03-18T18:25:35.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.855+0000 7f67837fe700 1 -- 172.21.15.94:0/119287448 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293057 (secure 0 0 0) 0x7f679c13da20 con 0x7f6788066730 2024-03-18T18:25:35.862 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6788066730 msgr2=0x7f6788068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6788066730 0x7f6788068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6790000f60 tx=0x7f6790009040 comp rx=0 tx=0).stop 2024-03-18T18:25:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 msgr2=0x7f679c071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:35.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c071400 secure :-1 s=READY pgs=4488 cs=0 l=1 rev1=1 crypto rx=0x7f678c00e870 tx=0x7f678c00eb80 comp rx=0 tx=0).stop 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 shutdown_connections 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6788066730 0x7f6788068bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f679c0b1090 0x7f679c071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f679c0afcf0 0x7f679c071400 unknown :-1 s=CLOSED pgs=4488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 --2- 172.21.15.94:0/119287448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f679c06cbc0 0x7f679c13f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 >> 172.21.15.94:0/119287448 conn(0x7f679c0b7a20 msgr2=0x7f679c0acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 shutdown_connections 2024-03-18T18:25:35.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:35.863+0000 7f679bfff700 1 -- 172.21.15.94:0/119287448 wait complete. 2024-03-18T18:25:35.867 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:25:35.881 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-03-18T18:25:34.913637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":264878012,"num_objects":229,"num_object_clones":28,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":13,"num_read":1722,"num_read_kb":4075,"num_write":163763,"num_write_kb":737620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327039,"ondisk_log_size":327039,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2961284,"kb_used_data":522228,"kb_used_omap":12,"kb_used_meta":2438963,"kb_avail":752013436,"statfs":{"total":773094113280,"available":770061758464,"internally_reserved":0,"allocated":534761472,"data_stored":531864134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2497498684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1118810,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":6,"num_read_kb":7,"num_write":92,"num_write_kb":1150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.922055"},"pg_stats":[{"pgid":"3.3f","version":"54'3531","reported_seq":2937,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629972+0000","last_change":"2024-03-18T18:25:29.057112+0000","last_active":"2024-03-18T18:25:30.629972+0000","last_peered":"2024-03-18T18:25:30.629972+0000","last_clean":"2024-03-18T18:25:30.629972+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:25:30.629972+0000","last_undegraded":"2024-03-18T18:25:30.629972+0000","last_fullsized":"2024-03-18T18:25:30.629972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3531,"log_dups_size":0,"ondisk_log_size":3531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3e","version":"54'3322","reported_seq":2747,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746698+0000","last_change":"2024-03-18T18:25:29.045338+0000","last_active":"2024-03-18T18:25:32.746698+0000","last_peered":"2024-03-18T18:25:32.746698+0000","last_clean":"2024-03-18T18:25:32.746698+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:25:32.746698+0000","last_undegraded":"2024-03-18T18:25:32.746698+0000","last_fullsized":"2024-03-18T18:25:32.746698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.3d","version":"54'3570","reported_seq":2978,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798788+0000","last_change":"2024-03-18T18:25:29.051316+0000","last_active":"2024-03-18T18:25:32.798788+0000","last_peered":"2024-03-18T18:25:32.798788+0000","last_clean":"2024-03-18T18:25:32.798788+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:32.798788+0000","last_undegraded":"2024-03-18T18:25:32.798788+0000","last_fullsized":"2024-03-18T18:25:32.798788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.3c","version":"54'3829","reported_seq":3135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.703386+0000","last_change":"2024-03-18T18:25:29.029488+0000","last_active":"2024-03-18T18:25:30.703386+0000","last_peered":"2024-03-18T18:25:30.703386+0000","last_clean":"2024-03-18T18:25:30.703386+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:25:30.703386+0000","last_undegraded":"2024-03-18T18:25:30.703386+0000","last_fullsized":"2024-03-18T18:25:30.703386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3b","version":"54'3564","reported_seq":2926,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.625944+0000","last_change":"2024-03-18T18:25:29.053880+0000","last_active":"2024-03-18T18:25:30.625944+0000","last_peered":"2024-03-18T18:25:30.625944+0000","last_clean":"2024-03-18T18:25:30.625944+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:25:30.625944+0000","last_undegraded":"2024-03-18T18:25:30.625944+0000","last_fullsized":"2024-03-18T18:25:30.625944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.3a","version":"54'3681","reported_seq":3009,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986656+0000","last_change":"2024-03-18T18:25:29.226526+0000","last_active":"2024-03-18T18:25:32.986656+0000","last_peered":"2024-03-18T18:25:32.986656+0000","last_clean":"2024-03-18T18:25:32.986656+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:25:32.986656+0000","last_undegraded":"2024-03-18T18:25:32.986656+0000","last_fullsized":"2024-03-18T18:25:32.986656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:13:50.287435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.39","version":"54'3918","reported_seq":3239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.673256+0000","last_change":"2024-03-18T18:25:29.050955+0000","last_active":"2024-03-18T18:25:30.673256+0000","last_peered":"2024-03-18T18:25:30.673256+0000","last_clean":"2024-03-18T18:25:30.673256+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:25:30.673256+0000","last_undegraded":"2024-03-18T18:25:30.673256+0000","last_fullsized":"2024-03-18T18:25:30.673256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3918,"log_dups_size":0,"ondisk_log_size":3918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":11,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.38","version":"54'3528","reported_seq":2938,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986528+0000","last_change":"2024-03-18T18:25:29.224146+0000","last_active":"2024-03-18T18:25:32.986528+0000","last_peered":"2024-03-18T18:25:32.986528+0000","last_clean":"2024-03-18T18:25:32.986528+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:25:32.986528+0000","last_undegraded":"2024-03-18T18:25:32.986528+0000","last_fullsized":"2024-03-18T18:25:32.986528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:28:08.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.37","version":"54'3888","reported_seq":3242,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.666631+0000","last_change":"2024-03-18T18:25:29.056418+0000","last_active":"2024-03-18T18:25:30.666631+0000","last_peered":"2024-03-18T18:25:30.666631+0000","last_clean":"2024-03-18T18:25:30.666631+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:25:30.666631+0000","last_undegraded":"2024-03-18T18:25:30.666631+0000","last_fullsized":"2024-03-18T18:25:30.666631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.36","version":"54'3823","reported_seq":3237,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.476053+0000","last_change":"2024-03-18T18:25:29.022953+0000","last_active":"2024-03-18T18:25:30.476053+0000","last_peered":"2024-03-18T18:25:30.476053+0000","last_clean":"2024-03-18T18:25:30.476053+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:25:30.476053+0000","last_undegraded":"2024-03-18T18:25:30.476053+0000","last_fullsized":"2024-03-18T18:25:30.476053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3823,"log_dups_size":0,"ondisk_log_size":3823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.35","version":"54'3532","reported_seq":2954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.445010+0000","last_change":"2024-03-18T18:25:29.017560+0000","last_active":"2024-03-18T18:25:30.445010+0000","last_peered":"2024-03-18T18:25:30.445010+0000","last_clean":"2024-03-18T18:25:30.445010+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:25:30.445010+0000","last_undegraded":"2024-03-18T18:25:30.445010+0000","last_fullsized":"2024-03-18T18:25:30.445010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.34","version":"54'4119","reported_seq":3410,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.503175+0000","last_change":"2024-03-18T18:25:29.195788+0000","last_active":"2024-03-18T18:25:30.503175+0000","last_peered":"2024-03-18T18:25:30.503175+0000","last_clean":"2024-03-18T18:25:30.503175+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:30.503175+0000","last_undegraded":"2024-03-18T18:25:30.503175+0000","last_fullsized":"2024-03-18T18:25:30.503175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.33","version":"54'3608","reported_seq":3014,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184078+0000","last_change":"2024-03-18T18:25:29.043841+0000","last_active":"2024-03-18T18:25:33.184078+0000","last_peered":"2024-03-18T18:25:33.184078+0000","last_clean":"2024-03-18T18:25:33.184078+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:25:33.184078+0000","last_undegraded":"2024-03-18T18:25:33.184078+0000","last_fullsized":"2024-03-18T18:25:33.184078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.32","version":"54'3871","reported_seq":3170,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798177+0000","last_change":"2024-03-18T18:25:29.047066+0000","last_active":"2024-03-18T18:25:32.798177+0000","last_peered":"2024-03-18T18:25:32.798177+0000","last_clean":"2024-03-18T18:25:32.798177+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:32.798177+0000","last_undegraded":"2024-03-18T18:25:32.798177+0000","last_fullsized":"2024-03-18T18:25:32.798177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:03:55.715506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.31","version":"54'3829","reported_seq":3152,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746701+0000","last_change":"2024-03-18T18:25:29.032597+0000","last_active":"2024-03-18T18:25:32.746701+0000","last_peered":"2024-03-18T18:25:32.746701+0000","last_clean":"2024-03-18T18:25:32.746701+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:25:32.746701+0000","last_undegraded":"2024-03-18T18:25:32.746701+0000","last_fullsized":"2024-03-18T18:25:32.746701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.30","version":"54'4022","reported_seq":3326,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.626154+0000","last_change":"2024-03-18T18:25:29.024791+0000","last_active":"2024-03-18T18:25:30.626154+0000","last_peered":"2024-03-18T18:25:30.626154+0000","last_clean":"2024-03-18T18:25:30.626154+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:25:30.626154+0000","last_undegraded":"2024-03-18T18:25:30.626154+0000","last_fullsized":"2024-03-18T18:25:30.626154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2f","version":"54'3787","reported_seq":3090,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.407396+0000","last_change":"2024-03-18T18:25:29.030461+0000","last_active":"2024-03-18T18:25:30.407396+0000","last_peered":"2024-03-18T18:25:30.407396+0000","last_clean":"2024-03-18T18:25:30.407396+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:25:30.407396+0000","last_undegraded":"2024-03-18T18:25:30.407396+0000","last_fullsized":"2024-03-18T18:25:30.407396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2e","version":"54'3740","reported_seq":3141,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986900+0000","last_change":"2024-03-18T18:25:29.221387+0000","last_active":"2024-03-18T18:25:32.986900+0000","last_peered":"2024-03-18T18:25:32.986900+0000","last_clean":"2024-03-18T18:25:32.986900+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:32.986900+0000","last_undegraded":"2024-03-18T18:25:32.986900+0000","last_fullsized":"2024-03-18T18:25:32.986900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:29.357575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.2d","version":"54'3972","reported_seq":3270,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.677987+0000","last_change":"2024-03-18T18:25:29.055765+0000","last_active":"2024-03-18T18:25:30.677987+0000","last_peered":"2024-03-18T18:25:30.677987+0000","last_clean":"2024-03-18T18:25:30.677987+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:25:30.677987+0000","last_undegraded":"2024-03-18T18:25:30.677987+0000","last_fullsized":"2024-03-18T18:25:30.677987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2c","version":"54'3755","reported_seq":3109,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.642916+0000","last_change":"2024-03-18T18:25:29.019398+0000","last_active":"2024-03-18T18:25:30.642916+0000","last_peered":"2024-03-18T18:25:30.642916+0000","last_clean":"2024-03-18T18:25:30.642916+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:25:30.642916+0000","last_undegraded":"2024-03-18T18:25:30.642916+0000","last_fullsized":"2024-03-18T18:25:30.642916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.2b","version":"54'3495","reported_seq":2913,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798768+0000","last_change":"2024-03-18T18:25:29.059001+0000","last_active":"2024-03-18T18:25:32.798768+0000","last_peered":"2024-03-18T18:25:32.798768+0000","last_clean":"2024-03-18T18:25:32.798768+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:25:32.798768+0000","last_undegraded":"2024-03-18T18:25:32.798768+0000","last_fullsized":"2024-03-18T18:25:32.798768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:51:49.555106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.2a","version":"54'4356","reported_seq":3571,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.716732+0000","last_change":"2024-03-18T18:25:29.035858+0000","last_active":"2024-03-18T18:25:30.716732+0000","last_peered":"2024-03-18T18:25:30.716732+0000","last_clean":"2024-03-18T18:25:30.716732+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:25:30.716732+0000","last_undegraded":"2024-03-18T18:25:30.716732+0000","last_fullsized":"2024-03-18T18:25:30.716732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4356,"log_dups_size":0,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:10:25.169636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.29","version":"54'3901","reported_seq":3232,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183300+0000","last_change":"2024-03-18T18:25:29.040440+0000","last_active":"2024-03-18T18:25:33.183300+0000","last_peered":"2024-03-18T18:25:33.183300+0000","last_clean":"2024-03-18T18:25:33.183300+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:25:33.183300+0000","last_undegraded":"2024-03-18T18:25:33.183300+0000","last_fullsized":"2024-03-18T18:25:33.183300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.28","version":"54'4190","reported_seq":3406,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.714777+0000","last_change":"2024-03-18T18:25:29.027847+0000","last_active":"2024-03-18T18:25:30.714777+0000","last_peered":"2024-03-18T18:25:30.714777+0000","last_clean":"2024-03-18T18:25:30.714777+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:25:30.714777+0000","last_undegraded":"2024-03-18T18:25:30.714777+0000","last_fullsized":"2024-03-18T18:25:30.714777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.27","version":"54'3282","reported_seq":2723,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184191+0000","last_change":"2024-03-18T18:25:29.043669+0000","last_active":"2024-03-18T18:25:33.184191+0000","last_peered":"2024-03-18T18:25:33.184191+0000","last_clean":"2024-03-18T18:25:33.184191+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:25:33.184191+0000","last_undegraded":"2024-03-18T18:25:33.184191+0000","last_fullsized":"2024-03-18T18:25:33.184191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.26","version":"54'3776","reported_seq":3134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.457472+0000","last_change":"2024-03-18T18:25:29.022945+0000","last_active":"2024-03-18T18:25:30.457472+0000","last_peered":"2024-03-18T18:25:30.457472+0000","last_clean":"2024-03-18T18:25:30.457472+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:25:30.457472+0000","last_undegraded":"2024-03-18T18:25:30.457472+0000","last_fullsized":"2024-03-18T18:25:30.457472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.25","version":"54'3857","reported_seq":3173,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746541+0000","last_change":"2024-03-18T18:25:29.046199+0000","last_active":"2024-03-18T18:25:32.746541+0000","last_peered":"2024-03-18T18:25:32.746541+0000","last_clean":"2024-03-18T18:25:32.746541+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:25:32.746541+0000","last_undegraded":"2024-03-18T18:25:32.746541+0000","last_fullsized":"2024-03-18T18:25:32.746541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3857,"log_dups_size":0,"ondisk_log_size":3857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.24","version":"54'3360","reported_seq":2802,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.185162+0000","last_change":"2024-03-18T18:25:29.046208+0000","last_active":"2024-03-18T18:25:33.185162+0000","last_peered":"2024-03-18T18:25:33.185162+0000","last_clean":"2024-03-18T18:25:33.185162+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:25:33.185162+0000","last_undegraded":"2024-03-18T18:25:33.185162+0000","last_fullsized":"2024-03-18T18:25:33.185162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.23","version":"54'3862","reported_seq":3200,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798386+0000","last_change":"2024-03-18T18:25:29.058196+0000","last_active":"2024-03-18T18:25:32.798386+0000","last_peered":"2024-03-18T18:25:32.798386+0000","last_clean":"2024-03-18T18:25:32.798386+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:25:32.798386+0000","last_undegraded":"2024-03-18T18:25:32.798386+0000","last_fullsized":"2024-03-18T18:25:32.798386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.22","version":"54'3274","reported_seq":2720,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.711595+0000","last_change":"2024-03-18T18:25:29.038378+0000","last_active":"2024-03-18T18:25:30.711595+0000","last_peered":"2024-03-18T18:25:30.711595+0000","last_clean":"2024-03-18T18:25:30.711595+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:25:30.711595+0000","last_undegraded":"2024-03-18T18:25:30.711595+0000","last_fullsized":"2024-03-18T18:25:30.711595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.21","version":"54'4260","reported_seq":3501,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986680+0000","last_change":"2024-03-18T18:25:29.230579+0000","last_active":"2024-03-18T18:25:32.986680+0000","last_peered":"2024-03-18T18:25:32.986680+0000","last_clean":"2024-03-18T18:25:32.986680+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:32.986680+0000","last_undegraded":"2024-03-18T18:25:32.986680+0000","last_fullsized":"2024-03-18T18:25:32.986680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4260,"log_dups_size":0,"ondisk_log_size":4260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"3.20","version":"54'3981","reported_seq":3267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629516+0000","last_change":"2024-03-18T18:25:29.022937+0000","last_active":"2024-03-18T18:25:30.629516+0000","last_peered":"2024-03-18T18:25:30.629516+0000","last_clean":"2024-03-18T18:25:30.629516+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:25:30.629516+0000","last_undegraded":"2024-03-18T18:25:30.629516+0000","last_fullsized":"2024-03-18T18:25:30.629516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":3,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1a","version":"54'4040","reported_seq":3306,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.631280+0000","last_change":"2024-03-18T18:25:29.190915+0000","last_active":"2024-03-18T18:25:30.631280+0000","last_peered":"2024-03-18T18:25:30.631280+0000","last_clean":"2024-03-18T18:25:30.631280+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:30.631280+0000","last_undegraded":"2024-03-18T18:25:30.631280+0000","last_fullsized":"2024-03-18T18:25:30.631280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4040,"log_dups_size":0,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:57.443112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1b","version":"48'1439","reported_seq":1489,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.031560+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:25:29.031560+0000","last_peered":"2024-03-18T18:25:29.031560+0000","last_clean":"2024-03-18T18:25:29.031560+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:29.031560+0000","last_undegraded":"2024-03-18T18:25:29.031560+0000","last_fullsized":"2024-03-18T18:25:29.031560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2981,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798690+0000","last_change":"2024-03-18T18:25:29.062033+0000","last_active":"2024-03-18T18:25:32.798690+0000","last_peered":"2024-03-18T18:25:32.798690+0000","last_clean":"2024-03-18T18:25:32.798690+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:32.798690+0000","last_undegraded":"2024-03-18T18:25:32.798690+0000","last_fullsized":"2024-03-18T18:25:32.798690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1a","version":"54'3527","reported_seq":3576,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.999798+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:25:28.999798+0000","last_peered":"2024-03-18T18:25:28.999798+0000","last_clean":"2024-03-18T18:25:28.999798+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:28.999798+0000","last_undegraded":"2024-03-18T18:25:28.999798+0000","last_fullsized":"2024-03-18T18:25:28.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"50'679","reported_seq":729,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.028140+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:25:29.028140+0000","last_peered":"2024-03-18T18:25:29.028140+0000","last_clean":"2024-03-18T18:25:29.028140+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:29.028140+0000","last_undegraded":"2024-03-18T18:25:29.028140+0000","last_fullsized":"2024-03-18T18:25:29.028140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"54'4461","reported_seq":3633,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.182868+0000","last_change":"2024-03-18T18:25:29.040660+0000","last_active":"2024-03-18T18:25:33.182868+0000","last_peered":"2024-03-18T18:25:33.182868+0000","last_clean":"2024-03-18T18:25:33.182868+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:25:33.182868+0000","last_undegraded":"2024-03-18T18:25:33.182868+0000","last_fullsized":"2024-03-18T18:25:33.182868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.18","version":"50'5546","reported_seq":5595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.995891+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:25:27.995891+0000","last_peered":"2024-03-18T18:25:27.995891+0000","last_clean":"2024-03-18T18:25:27.995891+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:27.995891+0000","last_undegraded":"2024-03-18T18:25:27.995891+0000","last_fullsized":"2024-03-18T18:25:27.995891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5546,"log_dups_size":0,"ondisk_log_size":5546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:17:34.144581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"54'3911","reported_seq":3234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.747326+0000","last_change":"2024-03-18T18:25:29.032708+0000","last_active":"2024-03-18T18:25:32.747326+0000","last_peered":"2024-03-18T18:25:32.747326+0000","last_clean":"2024-03-18T18:25:32.747326+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:25:32.747326+0000","last_undegraded":"2024-03-18T18:25:32.747326+0000","last_fullsized":"2024-03-18T18:25:32.747326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.17","version":"54'1835","reported_seq":1884,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.551150+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:25:30.551150+0000","last_peered":"2024-03-18T18:25:30.551150+0000","last_clean":"2024-03-18T18:25:30.551150+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:30.551150+0000","last_undegraded":"2024-03-18T18:25:30.551150+0000","last_fullsized":"2024-03-18T18:25:30.551150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17202751,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1942,"num_write_kb":18495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"54'3669","reported_seq":3075,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.660214+0000","last_change":"2024-03-18T18:25:29.027139+0000","last_active":"2024-03-18T18:25:30.660214+0000","last_peered":"2024-03-18T18:25:30.660214+0000","last_clean":"2024-03-18T18:25:30.660214+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:25:30.660214+0000","last_undegraded":"2024-03-18T18:25:30.660214+0000","last_fullsized":"2024-03-18T18:25:30.660214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.16","version":"50'2293","reported_seq":2342,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.997045+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:25:27.997045+0000","last_peered":"2024-03-18T18:25:27.997045+0000","last_clean":"2024-03-18T18:25:27.997045+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:27.997045+0000","last_undegraded":"2024-03-18T18:25:27.997045+0000","last_fullsized":"2024-03-18T18:25:27.997045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"54'3704","reported_seq":3070,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.800565+0000","last_change":"2024-03-18T18:25:29.055272+0000","last_active":"2024-03-18T18:25:32.800565+0000","last_peered":"2024-03-18T18:25:32.800565+0000","last_clean":"2024-03-18T18:25:32.800565+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:32.800565+0000","last_undegraded":"2024-03-18T18:25:32.800565+0000","last_fullsized":"2024-03-18T18:25:32.800565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.15","version":"54'2695","reported_seq":2745,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.310867+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:25:31.310867+0000","last_peered":"2024-03-18T18:25:31.310867+0000","last_clean":"2024-03-18T18:25:31.310867+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:25:31.310867+0000","last_undegraded":"2024-03-18T18:25:31.310867+0000","last_fullsized":"2024-03-18T18:25:31.310867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:28.346468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"54'3872","reported_seq":3229,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.627683+0000","last_change":"2024-03-18T18:25:29.195869+0000","last_active":"2024-03-18T18:25:30.627683+0000","last_peered":"2024-03-18T18:25:30.627683+0000","last_clean":"2024-03-18T18:25:30.627683+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:30.627683+0000","last_undegraded":"2024-03-18T18:25:30.627683+0000","last_fullsized":"2024-03-18T18:25:30.627683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:36.727056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.14","version":"50'3867","reported_seq":3916,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.105272+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:25:28.105272+0000","last_peered":"2024-03-18T18:25:28.105272+0000","last_clean":"2024-03-18T18:25:28.105272+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:28.105272+0000","last_undegraded":"2024-03-18T18:25:28.105272+0000","last_fullsized":"2024-03-18T18:25:28.105272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3867,"log_dups_size":0,"ondisk_log_size":3867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3978,"num_write_kb":30874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"54'3911","reported_seq":3206,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.666167+0000","last_change":"2024-03-18T18:25:29.054617+0000","last_active":"2024-03-18T18:25:30.666167+0000","last_peered":"2024-03-18T18:25:30.666167+0000","last_clean":"2024-03-18T18:25:30.666167+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:25:30.666167+0000","last_undegraded":"2024-03-18T18:25:30.666167+0000","last_fullsized":"2024-03-18T18:25:30.666167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.13","version":"50'2794","reported_seq":2845,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799151+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:25:32.799151+0000","last_peered":"2024-03-18T18:25:32.799151+0000","last_clean":"2024-03-18T18:25:32.799151+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:32.799151+0000","last_undegraded":"2024-03-18T18:25:32.799151+0000","last_fullsized":"2024-03-18T18:25:32.799151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2794,"log_dups_size":0,"ondisk_log_size":2794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"54'3870","reported_seq":3181,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.798503+0000","last_change":"2024-03-18T18:25:29.049751+0000","last_active":"2024-03-18T18:25:32.798503+0000","last_peered":"2024-03-18T18:25:32.798503+0000","last_clean":"2024-03-18T18:25:32.798503+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:32.798503+0000","last_undegraded":"2024-03-18T18:25:32.798503+0000","last_fullsized":"2024-03-18T18:25:32.798503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.12","version":"54'148","reported_seq":197,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.004884+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:25:29.004884+0000","last_peered":"2024-03-18T18:25:29.004884+0000","last_clean":"2024-03-18T18:25:29.004884+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:25:29.004884+0000","last_undegraded":"2024-03-18T18:25:29.004884+0000","last_fullsized":"2024-03-18T18:25:29.004884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3403,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.641498+0000","last_change":"2024-03-18T18:25:29.053722+0000","last_active":"2024-03-18T18:25:30.641498+0000","last_peered":"2024-03-18T18:25:30.641498+0000","last_clean":"2024-03-18T18:25:30.641498+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:25:30.641498+0000","last_undegraded":"2024-03-18T18:25:30.641498+0000","last_fullsized":"2024-03-18T18:25:30.641498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.11","version":"48'1126","reported_seq":1175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.104928+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:25:28.104928+0000","last_peered":"2024-03-18T18:25:28.104928+0000","last_clean":"2024-03-18T18:25:28.104928+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:28.104928+0000","last_undegraded":"2024-03-18T18:25:28.104928+0000","last_fullsized":"2024-03-18T18:25:28.104928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"54'3648","reported_seq":2965,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.629417+0000","last_change":"2024-03-18T18:25:29.016810+0000","last_active":"2024-03-18T18:25:30.629417+0000","last_peered":"2024-03-18T18:25:30.629417+0000","last_clean":"2024-03-18T18:25:30.629417+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:25:30.629417+0000","last_undegraded":"2024-03-18T18:25:30.629417+0000","last_fullsized":"2024-03-18T18:25:30.629417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3648,"log_dups_size":0,"ondisk_log_size":3648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.10","version":"54'1551","reported_seq":1602,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.986702+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:25:32.986702+0000","last_peered":"2024-03-18T18:25:32.986702+0000","last_clean":"2024-03-18T18:25:32.986702+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:32.986702+0000","last_undegraded":"2024-03-18T18:25:32.986702+0000","last_fullsized":"2024-03-18T18:25:32.986702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"54'4132","reported_seq":3360,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.676821+0000","last_change":"2024-03-18T18:25:29.051925+0000","last_active":"2024-03-18T18:25:30.676821+0000","last_peered":"2024-03-18T18:25:30.676821+0000","last_clean":"2024-03-18T18:25:30.676821+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:25:30.676821+0000","last_undegraded":"2024-03-18T18:25:30.676821+0000","last_fullsized":"2024-03-18T18:25:30.676821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4132,"log_dups_size":0,"ondisk_log_size":4132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.f","version":"48'1388","reported_seq":1438,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.108197+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:25:28.108197+0000","last_peered":"2024-03-18T18:25:28.108197+0000","last_clean":"2024-03-18T18:25:28.108197+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:28.108197+0000","last_undegraded":"2024-03-18T18:25:28.108197+0000","last_fullsized":"2024-03-18T18:25:28.108197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:09.487901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"54'3700","reported_seq":3040,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.660977+0000","last_change":"2024-03-18T18:25:29.056125+0000","last_active":"2024-03-18T18:25:30.660977+0000","last_peered":"2024-03-18T18:25:30.660977+0000","last_clean":"2024-03-18T18:25:30.660977+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:30.660977+0000","last_undegraded":"2024-03-18T18:25:30.660977+0000","last_fullsized":"2024-03-18T18:25:30.660977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.e","version":"50'1377","reported_seq":1428,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.205286+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:25:29.205286+0000","last_peered":"2024-03-18T18:25:29.205286+0000","last_clean":"2024-03-18T18:25:29.205286+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:29.205286+0000","last_undegraded":"2024-03-18T18:25:29.205286+0000","last_fullsized":"2024-03-18T18:25:29.205286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"54'4065","reported_seq":3351,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.987166+0000","last_change":"2024-03-18T18:25:29.226986+0000","last_active":"2024-03-18T18:25:32.987166+0000","last_peered":"2024-03-18T18:25:32.987166+0000","last_clean":"2024-03-18T18:25:32.987166+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:25:32.987166+0000","last_undegraded":"2024-03-18T18:25:32.987166+0000","last_fullsized":"2024-03-18T18:25:32.987166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4065,"log_dups_size":0,"ondisk_log_size":4065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:22:20.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.d","version":"50'4629","reported_seq":4680,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.998187+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:25:28.998187+0000","last_peered":"2024-03-18T18:25:28.998187+0000","last_clean":"2024-03-18T18:25:28.998187+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:28.998187+0000","last_undegraded":"2024-03-18T18:25:28.998187+0000","last_fullsized":"2024-03-18T18:25:28.998187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3738","reported_seq":3058,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.703287+0000","last_change":"2024-03-18T18:25:29.033548+0000","last_active":"2024-03-18T18:25:30.703287+0000","last_peered":"2024-03-18T18:25:30.703287+0000","last_clean":"2024-03-18T18:25:30.703287+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:25:30.703287+0000","last_undegraded":"2024-03-18T18:25:30.703287+0000","last_fullsized":"2024-03-18T18:25:30.703287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3738,"log_dups_size":0,"ondisk_log_size":3738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:58.540314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.c","version":"48'5034","reported_seq":5085,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.205485+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:25:29.205485+0000","last_peered":"2024-03-18T18:25:29.205485+0000","last_clean":"2024-03-18T18:25:29.205485+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:29.205485+0000","last_undegraded":"2024-03-18T18:25:29.205485+0000","last_fullsized":"2024-03-18T18:25:29.205485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5034,"log_dups_size":0,"ondisk_log_size":5034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'3518","reported_seq":2894,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.676401+0000","last_change":"2024-03-18T18:25:29.055382+0000","last_active":"2024-03-18T18:25:30.676401+0000","last_peered":"2024-03-18T18:25:30.676401+0000","last_clean":"2024-03-18T18:25:30.676401+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:25:30.676401+0000","last_undegraded":"2024-03-18T18:25:30.676401+0000","last_fullsized":"2024-03-18T18:25:30.676401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3518,"log_dups_size":0,"ondisk_log_size":3518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:00.566254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"1.0","version":"18'117","reported_seq":204,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.103195+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:25:28.103195+0000","last_peered":"2024-03-18T18:25:28.103195+0000","last_clean":"2024-03-18T18:25:28.103195+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:28.103195+0000","last_undegraded":"2024-03-18T18:25:28.103195+0000","last_fullsized":"2024-03-18T18:25:28.103195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"50'1920","reported_seq":1970,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.996090+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:25:27.996090+0000","last_peered":"2024-03-18T18:25:27.996090+0000","last_clean":"2024-03-18T18:25:27.996090+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:27.996090+0000","last_undegraded":"2024-03-18T18:25:27.996090+0000","last_fullsized":"2024-03-18T18:25:27.996090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3134,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184197+0000","last_change":"2024-03-18T18:25:29.046186+0000","last_active":"2024-03-18T18:25:33.184197+0000","last_peered":"2024-03-18T18:25:33.184197+0000","last_clean":"2024-03-18T18:25:33.184197+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:33.184197+0000","last_undegraded":"2024-03-18T18:25:33.184197+0000","last_fullsized":"2024-03-18T18:25:33.184197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.0","version":"50'4975","reported_seq":5026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.103154+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:25:28.103154+0000","last_peered":"2024-03-18T18:25:28.103154+0000","last_clean":"2024-03-18T18:25:28.103154+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:28.103154+0000","last_undegraded":"2024-03-18T18:25:28.103154+0000","last_fullsized":"2024-03-18T18:25:28.103154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4975,"log_dups_size":0,"ondisk_log_size":4975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2932,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.797905+0000","last_change":"2024-03-18T18:25:29.042446+0000","last_active":"2024-03-18T18:25:32.797905+0000","last_peered":"2024-03-18T18:25:32.797905+0000","last_clean":"2024-03-18T18:25:32.797905+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:32.797905+0000","last_undegraded":"2024-03-18T18:25:32.797905+0000","last_fullsized":"2024-03-18T18:25:32.797905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1","version":"54'2669","reported_seq":3260,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.301894+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:25:31.301894+0000","last_peered":"2024-03-18T18:25:31.301894+0000","last_clean":"2024-03-18T18:25:31.301894+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:31.301894+0000","last_undegraded":"2024-03-18T18:25:31.301894+0000","last_fullsized":"2024-03-18T18:25:31.301894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"54'4235","reported_seq":3482,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746406+0000","last_change":"2024-03-18T18:25:29.032416+0000","last_active":"2024-03-18T18:25:32.746406+0000","last_peered":"2024-03-18T18:25:32.746406+0000","last_clean":"2024-03-18T18:25:32.746406+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:25:32.746406+0000","last_undegraded":"2024-03-18T18:25:32.746406+0000","last_fullsized":"2024-03-18T18:25:32.746406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4235,"log_dups_size":0,"ondisk_log_size":4235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.2","version":"50'5920","reported_seq":5970,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:27.996813+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:25:27.996813+0000","last_peered":"2024-03-18T18:25:27.996813+0000","last_clean":"2024-03-18T18:25:27.996813+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:27.996813+0000","last_undegraded":"2024-03-18T18:25:27.996813+0000","last_fullsized":"2024-03-18T18:25:27.996813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5920,"log_dups_size":0,"ondisk_log_size":5920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3974","reported_seq":3243,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.620681+0000","last_change":"2024-03-18T18:25:29.192820+0000","last_active":"2024-03-18T18:25:30.620681+0000","last_peered":"2024-03-18T18:25:30.620681+0000","last_clean":"2024-03-18T18:25:30.620681+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:30.620681+0000","last_undegraded":"2024-03-18T18:25:30.620681+0000","last_fullsized":"2024-03-18T18:25:30.620681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:43.456614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.4","version":"54'954","reported_seq":1005,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.299607+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:25:31.299607+0000","last_peered":"2024-03-18T18:25:31.299607+0000","last_clean":"2024-03-18T18:25:31.299607+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:31.299607+0000","last_undegraded":"2024-03-18T18:25:31.299607+0000","last_fullsized":"2024-03-18T18:25:31.299607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"54'3615","reported_seq":3002,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.690582+0000","last_change":"2024-03-18T18:25:29.037811+0000","last_active":"2024-03-18T18:25:30.690582+0000","last_peered":"2024-03-18T18:25:30.690582+0000","last_clean":"2024-03-18T18:25:30.690582+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:25:30.690582+0000","last_undegraded":"2024-03-18T18:25:30.690582+0000","last_fullsized":"2024-03-18T18:25:30.690582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.5","version":"48'3704","reported_seq":3754,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106822+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:25:28.106822+0000","last_peered":"2024-03-18T18:25:28.106822+0000","last_clean":"2024-03-18T18:25:28.106822+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:25:28.106822+0000","last_undegraded":"2024-03-18T18:25:28.106822+0000","last_fullsized":"2024-03-18T18:25:28.106822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3185,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.746463+0000","last_change":"2024-03-18T18:25:29.039953+0000","last_active":"2024-03-18T18:25:32.746463+0000","last_peered":"2024-03-18T18:25:32.746463+0000","last_clean":"2024-03-18T18:25:32.746463+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:25:32.746463+0000","last_undegraded":"2024-03-18T18:25:32.746463+0000","last_fullsized":"2024-03-18T18:25:32.746463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.6","version":"54'2145","reported_seq":2196,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:31.011889+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:25:31.011889+0000","last_peered":"2024-03-18T18:25:31.011889+0000","last_clean":"2024-03-18T18:25:31.011889+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:31.011889+0000","last_undegraded":"2024-03-18T18:25:31.011889+0000","last_fullsized":"2024-03-18T18:25:31.011889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2145,"log_dups_size":0,"ondisk_log_size":2145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:42.445506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2812,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184726+0000","last_change":"2024-03-18T18:25:29.044961+0000","last_active":"2024-03-18T18:25:33.184726+0000","last_peered":"2024-03-18T18:25:33.184726+0000","last_clean":"2024-03-18T18:25:33.184726+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:25:33.184726+0000","last_undegraded":"2024-03-18T18:25:33.184726+0000","last_fullsized":"2024-03-18T18:25:33.184726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.7","version":"50'1819","reported_seq":1869,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106751+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:25:28.106751+0000","last_peered":"2024-03-18T18:25:28.106751+0000","last_clean":"2024-03-18T18:25:28.106751+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:28.106751+0000","last_undegraded":"2024-03-18T18:25:28.106751+0000","last_fullsized":"2024-03-18T18:25:28.106751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1819,"log_dups_size":0,"ondisk_log_size":1819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'3540","reported_seq":2943,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799415+0000","last_change":"2024-03-18T18:25:29.063216+0000","last_active":"2024-03-18T18:25:32.799415+0000","last_peered":"2024-03-18T18:25:32.799415+0000","last_clean":"2024-03-18T18:25:32.799415+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:32.799415+0000","last_undegraded":"2024-03-18T18:25:32.799415+0000","last_fullsized":"2024-03-18T18:25:32.799415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.8","version":"48'1602","reported_seq":1652,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.102909+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:25:28.102909+0000","last_peered":"2024-03-18T18:25:28.102909+0000","last_clean":"2024-03-18T18:25:28.102909+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:25:28.102909+0000","last_undegraded":"2024-03-18T18:25:28.102909+0000","last_fullsized":"2024-03-18T18:25:28.102909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1602,"log_dups_size":0,"ondisk_log_size":1602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"54'3735","reported_seq":3026,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.477612+0000","last_change":"2024-03-18T18:25:29.194592+0000","last_active":"2024-03-18T18:25:30.477612+0000","last_peered":"2024-03-18T18:25:30.477612+0000","last_clean":"2024-03-18T18:25:30.477612+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:30.477612+0000","last_undegraded":"2024-03-18T18:25:30.477612+0000","last_fullsized":"2024-03-18T18:25:30.477612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3735,"log_dups_size":0,"ondisk_log_size":3735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:36.490441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.9","version":"50'2478","reported_seq":2529,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.997253+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:25:28.997253+0000","last_peered":"2024-03-18T18:25:28.997253+0000","last_clean":"2024-03-18T18:25:28.997253+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:28.997253+0000","last_undegraded":"2024-03-18T18:25:28.997253+0000","last_fullsized":"2024-03-18T18:25:28.997253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2478,"log_dups_size":0,"ondisk_log_size":2478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"54'3993","reported_seq":3320,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183031+0000","last_change":"2024-03-18T18:25:29.042734+0000","last_active":"2024-03-18T18:25:33.183031+0000","last_peered":"2024-03-18T18:25:33.183031+0000","last_clean":"2024-03-18T18:25:33.183031+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:33.183031+0000","last_undegraded":"2024-03-18T18:25:33.183031+0000","last_fullsized":"2024-03-18T18:25:33.183031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.a","version":"50'2622","reported_seq":2673,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.997606+0000","last_change":"2024-03-18T18:09:12.446707+0000","last_active":"2024-03-18T18:25:28.997606+0000","last_peered":"2024-03-18T18:25:28.997606+0000","last_clean":"2024-03-18T18:25:28.997606+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:28.997606+0000","last_undegraded":"2024-03-18T18:25:28.997606+0000","last_fullsized":"2024-03-18T18:25:28.997606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2622,"log_dups_size":0,"ondisk_log_size":2622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'3488","reported_seq":2910,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184638+0000","last_change":"2024-03-18T18:25:29.044854+0000","last_active":"2024-03-18T18:25:33.184638+0000","last_peered":"2024-03-18T18:25:33.184638+0000","last_clean":"2024-03-18T18:25:33.184638+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:25:33.184638+0000","last_undegraded":"2024-03-18T18:25:33.184638+0000","last_fullsized":"2024-03-18T18:25:33.184638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.b","version":"48'4482","reported_seq":4532,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106243+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:25:28.106243+0000","last_peered":"2024-03-18T18:25:28.106243+0000","last_clean":"2024-03-18T18:25:28.106243+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:25:28.106243+0000","last_undegraded":"2024-03-18T18:25:28.106243+0000","last_fullsized":"2024-03-18T18:25:28.106243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4482,"log_dups_size":0,"ondisk_log_size":4482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"54'3776","reported_seq":3131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.598753+0000","last_change":"2024-03-18T18:25:29.014675+0000","last_active":"2024-03-18T18:25:30.598753+0000","last_peered":"2024-03-18T18:25:30.598753+0000","last_clean":"2024-03-18T18:25:30.598753+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:25:30.598753+0000","last_undegraded":"2024-03-18T18:25:30.598753+0000","last_fullsized":"2024-03-18T18:25:30.598753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"3.1d","version":"54'3708","reported_seq":3115,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.700610+0000","last_change":"2024-03-18T18:25:29.035433+0000","last_active":"2024-03-18T18:25:30.700610+0000","last_peered":"2024-03-18T18:25:30.700610+0000","last_clean":"2024-03-18T18:25:30.700610+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:25:30.700610+0000","last_undegraded":"2024-03-18T18:25:30.700610+0000","last_fullsized":"2024-03-18T18:25:30.700610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3708,"log_dups_size":0,"ondisk_log_size":3708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":3,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1c","version":"51'1387","reported_seq":1436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.105343+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:25:28.105343+0000","last_peered":"2024-03-18T18:25:28.105343+0000","last_clean":"2024-03-18T18:25:28.105343+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:25:28.105343+0000","last_undegraded":"2024-03-18T18:25:28.105343+0000","last_fullsized":"2024-03-18T18:25:28.105343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4100","reported_seq":3372,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:30.702015+0000","last_change":"2024-03-18T18:25:29.032671+0000","last_active":"2024-03-18T18:25:30.702015+0000","last_peered":"2024-03-18T18:25:30.702015+0000","last_clean":"2024-03-18T18:25:30.702015+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:25:30.702015+0000","last_undegraded":"2024-03-18T18:25:30.702015+0000","last_fullsized":"2024-03-18T18:25:30.702015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4100,"log_dups_size":0,"ondisk_log_size":4100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:53:04.276313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3c","length":"6"}]},{"pgid":"2.1d","version":"50'3529","reported_seq":3578,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-03-18T18:25:28.106016+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:25:28.106016+0000","last_peered":"2024-03-18T18:25:28.106016+0000","last_clean":"2024-03-18T18:25:28.106016+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:25:28.106016+0000","last_undegraded":"2024-03-18T18:25:28.106016+0000","last_fullsized":"2024-03-18T18:25:28.106016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"54'3441","reported_seq":2892,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.799819+0000","last_change":"2024-03-18T18:25:29.053757+0000","last_active":"2024-03-18T18:25:32.799819+0000","last_peered":"2024-03-18T18:25:32.799819+0000","last_clean":"2024-03-18T18:25:32.799819+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:25:32.799819+0000","last_undegraded":"2024-03-18T18:25:32.799819+0000","last_fullsized":"2024-03-18T18:25:32.799819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1e","version":"50'3382","reported_seq":3434,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.034174+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:25:29.034174+0000","last_peered":"2024-03-18T18:25:29.034174+0000","last_clean":"2024-03-18T18:25:29.034174+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:29.034174+0000","last_undegraded":"2024-03-18T18:25:29.034174+0000","last_fullsized":"2024-03-18T18:25:29.034174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"54'3368","reported_seq":2785,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184383+0000","last_change":"2024-03-18T18:25:29.047446+0000","last_active":"2024-03-18T18:25:33.184383+0000","last_peered":"2024-03-18T18:25:33.184383+0000","last_clean":"2024-03-18T18:25:33.184383+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:25:33.184383+0000","last_undegraded":"2024-03-18T18:25:33.184383+0000","last_fullsized":"2024-03-18T18:25:33.184383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"40","length":"2"}]},{"pgid":"2.1f","version":"50'1528","reported_seq":1579,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-03-18T18:25:29.006189+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:25:29.006189+0000","last_peered":"2024-03-18T18:25:29.006189+0000","last_clean":"2024-03-18T18:25:29.006189+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:29.006189+0000","last_undegraded":"2024-03-18T18:25:29.006189+0000","last_fullsized":"2024-03-18T18:25:29.006189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127205,"num_objects":128,"num_object_clones":28,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":128,"num_whiteouts":13,"num_read":31,"num_read_kb":21,"num_write":75036,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":254396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241878,"ondisk_log_size":241878,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264160439,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88568,"num_write_kb":694604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384000,"data_stored":528320878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85044,"ondisk_log_size":85044,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476938,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404708,"kb_used_data":66780,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967132,"statfs":{"total":96636764160,"available":96222343168,"internally_reserved":0,"allocated":68382720,"data_stored":68015462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.628,"15min":0.69599999999999995},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.82099999999999995,"5min":1.119,"15min":5.4859999999999998},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.83899999999999997,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.75900000000000001,"15min":0.79400000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.099,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.80800000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":1.05,"15min":1.5009999999999999},"last":1.113}]},{"osd":2,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.68600000000000005,"15min":0.755},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.3700000000000001},"last":0.996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.78500000000000003,"15min":0.82499999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.135,"5min":1.655,"15min":5.452},"last":0.78500000000000003}]},{"osd":3,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79200000000000004,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1259999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":0.90600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99099999999999999,"5min":1.5349999999999999,"15min":2.5859999999999999},"last":1.244}]},{"osd":4,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.69699999999999995,"15min":0.76000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76600000000000001,"5min":1.726,"15min":1.726},"last":1.079},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.78500000000000003,"15min":0.83199999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":1.0640000000000001,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.76700000000000002,"15min":0.88600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.171,"5min":1.4890000000000001,"15min":4.1150000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.85899999999999999,"15min":0.94799999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.1479999999999999,"5min":1.6240000000000001,"15min":4.2350000000000003},"last":1.1439999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.90000000000000002,"15min":0.94399999999999995},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":2.0379999999999998,"5min":3.024,"15min":4.1840000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.85099999999999998,"15min":0.95399999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":3.1709999999999998,"15min":5.431},"last":1.0509999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366720,"kb_used_data":78904,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94005120,"statfs":{"total":96636764160,"available":96261242880,"internally_reserved":0,"allocated":80797696,"data_stored":80441792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.76200000000000001},"min":{"1min":0.28899999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1060000000000001,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91800000000000004,"15min":0.84099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.224,"5min":10.127000000000001,"15min":10.127000000000001},"last":1.073}]},{"osd":1,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95099999999999996,"15min":0.81999999999999995},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":12.565,"15min":12.565},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.087,"15min":0.88300000000000001},"min":{"1min":0.42199999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":16.579999999999998,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.995}]},{"osd":2,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.76400000000000001},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.6859999999999999,"5min":6.202,"15min":6.202},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.157,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.98799999999999999,"15min":0.90200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.1320000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.113,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.33500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.208,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.45000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.726,"5min":10.08,"15min":10.08},"last":1.1399999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.83199999999999996,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":27.231000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.054,"15min":1.113},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.351,"5min":9.2509999999999994,"15min":27.478999999999999},"last":1.046}]},{"osd":7,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.56999999999999995,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4570000000000001,"5min":10.182,"15min":10.182},"last":1.206},{"interface":"front","average":{"1min":1.02,"5min":0.86099999999999999,"15min":0.95499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.474,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.103}]}]},{"osd":5,"up_from":16,"seq":68719476938,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":513464,"kb_used_data":103344,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93858376,"statfs":{"total":96636764160,"available":96110977024,"internally_reserved":0,"allocated":105824256,"data_stored":105454885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":2.073,"5min":2.073,"15min":3.6739999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.7150000000000001,"5min":0.874,"15min":0.80800000000000005},"min":{"1min":0.57399999999999995,"5min":0.255,"15min":0.255},"max":{"1min":20.013000000000002,"5min":20.013000000000002,"15min":20.013000000000002},"last":0.78400000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":7.2469999999999999,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.3160000000000001,"5min":0.85799999999999998,"15min":0.83199999999999996},"min":{"1min":0.48199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.231,"5min":10.231,"15min":10.231},"last":0.75}]},{"osd":2,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":0.876,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.041,"5min":12.041,"15min":12.041},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.317,"15min":0.317},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.57099999999999995}]},{"osd":3,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":0.999,"15min":0.92600000000000005},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":16.183,"5min":16.183,"15min":16.183},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.125,"5min":0.89000000000000001,"15min":0.97199999999999998},"min":{"1min":0.61799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":13.678000000000001},"last":0.91400000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.71499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.85799999999999998,"15min":0.90300000000000002},"min":{"1min":0.74399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":0.94599999999999995}]},{"osd":6,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.89000000000000001,"15min":0.93200000000000005},"min":{"1min":0.66300000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.89000000000000001,"15min":0.94499999999999995},"min":{"1min":0.64800000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.88600000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.0860000000000001,"15min":1.0549999999999999},"min":{"1min":0.63500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.766,"5min":12.766,"15min":12.766},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.091,"15min":1.083},"min":{"1min":0.77700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":12.788,"5min":12.788,"15min":12.788},"last":1.03}]}]},{"osd":4,"up_from":16,"seq":68719476936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422104,"kb_used_data":53900,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":93949736,"statfs":{"total":96636764160,"available":96204529664,"internally_reserved":0,"allocated":55193600,"data_stored":54833645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.69999999999999996,"15min":0.71699999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.8109999999999999,"5min":2.536,"15min":2.536},"last":0.88},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.64500000000000002,"15min":0.69899999999999995},"min":{"1min":0.252,"5min":0.251,"15min":0.251},"max":{"1min":0.81200000000000006,"5min":1.335,"15min":1.946},"last":0.73599999999999999}]},{"osd":1,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.76400000000000001,"15min":0.75800000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.93400000000000005,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.73599999999999999,"15min":0.80400000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.1970000000000001,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.80600000000000005,"15min":0.84899999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.046}]},{"osd":3,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.81699999999999995},"min":{"1min":0.30399999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.877,"15min":0.89600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.012,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.71599999999999997}]},{"osd":5,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.77800000000000002,"15min":0.84999999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.251},"max":{"1min":0.91800000000000004,"5min":2.613,"15min":4.7119999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.80500000000000005,"15min":0.89000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0609999999999999,"5min":1.393,"15min":4.7480000000000002},"last":0.84899999999999998}]},{"osd":6,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.85699999999999998,"15min":0.91100000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4770000000000001,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.88700000000000001,"15min":0.96099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.2190000000000001,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Mon Mar 18 18:24:31 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.84899999999999998,"15min":0.93700000000000006},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.141,"5min":1.3979999999999999,"15min":3.96},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.96499999999999997,"15min":1.0269999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.1830000000000001,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.1040000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509642,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260828,"kb_used_data":45200,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111012,"statfs":{"total":96636764160,"available":96369676288,"internally_reserved":0,"allocated":46284800,"data_stored":45930721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.20499999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.65000000000000002,"15min":0.67700000000000005},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.4039999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.71099999999999997,"15min":0.68799999999999994},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90900000000000003,"5min":1.1759999999999999,"15min":1.3149999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.78600000000000003,"15min":0.76700000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0209999999999999,"5min":1.216,"15min":1.3},"last":0.66300000000000003}]},{"osd":3,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":0.84899999999999998,"15min":0.78000000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":12.778,"5min":12.778,"15min":12.778},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":0.94399999999999995,"15min":0.82199999999999995},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":12.84,"5min":12.84,"15min":12.84},"last":0.71599999999999997}]},{"osd":4,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.82999999999999996,"15min":0.85599999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0760000000000001,"5min":1.526,"15min":1.526},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.99399999999999999,"15min":0.95999999999999996},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":6.9729999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.0920000000000001,"15min":1.0149999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":12.807,"5min":12.807,"15min":12.807},"last":1.169},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.1599999999999999,"15min":1.0389999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":19.149000000000001,"5min":19.149000000000001,"15min":19.149000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":1.0409999999999999,"15min":1.046},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.244,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.012},{"interface":"front","average":{"1min":0.83899999999999997,"5min":1.02,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.45,"5min":1.45,"15min":1.6859999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:24:34 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0469999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2030000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.052},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.0469999999999999,"15min":1.073},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.27,"5min":1.518,"15min":1.8320000000000001},"last":1.071}]}]},{"osd":1,"up_from":15,"seq":64424509642,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410660,"kb_used_data":90776,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961180,"statfs":{"total":96636764160,"available":96216248320,"internally_reserved":0,"allocated":92954624,"data_stored":92588564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.1359999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.0189999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0620000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.58899999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.80800000000000005},"min":{"1min":0.38100000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.0289999999999999,"5min":2.8170000000000002,"15min":4.069},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.88700000000000001,"15min":0.86399999999999999},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.339,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2130000000000001,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":1.0209999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0740000000000001},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.29,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.48699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.91600000000000004}]},{"osd":7,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.56000000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2370000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":4.1509999999999998,"5min":4.1509999999999998,"15min":4.798},"last":0.88200000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542346,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319144,"kb_used_data":49312,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052696,"statfs":{"total":96636764160,"available":96309960704,"internally_reserved":0,"allocated":50495488,"data_stored":50136006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.747},{"interface":"front","average":{"1min":1.1659999999999999,"5min":0.77800000000000002,"15min":0.71299999999999997},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":11.132,"5min":11.132,"15min":11.132},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.30199999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.421,"5min":1.857,"15min":3.3839999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.86399999999999999,"15min":0.78200000000000003},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.331,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.872,"15min":0.876},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.95999999999999996,"15min":0.94699999999999995},"min":{"1min":0.504,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":2.609,"15min":2.609},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":1.008},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.587,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.026}]},{"osd":6,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.6259999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.157,"15min":1.0860000000000001},"min":{"1min":0.54600000000000004,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":13.02,"5min":13.02,"15min":13.02},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":1.893,"15min":1.9139999999999999},"last":1.157}]}]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263656,"kb_used_data":34012,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108184,"statfs":{"total":96636764160,"available":96366780416,"internally_reserved":0,"allocated":34828288,"data_stored":34463059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.68000000000000005,"15min":0.621},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.0229999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.37,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.0140000000000002,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.441},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96599999999999997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.59599999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.82199999999999995,"15min":0.77100000000000002},"min":{"1min":0.41199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.226,"5min":0.93000000000000005,"15min":0.85599999999999998},"min":{"1min":0.48399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.623}]},{"osd":4,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.66000000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.125,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.94899999999999995}]},{"osd":5,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0169999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":5.0650000000000004,"5min":14.869,"15min":14.869},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.0880000000000001,"15min":1.022},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4870000000000001,"5min":14.804,"15min":14.804},"last":0.749}]},{"osd":6,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.157,"15min":1.0660000000000001},"min":{"1min":0.64300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.4049999999999994,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4259999999999999,"5min":2.113,"15min":2.113},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.455,"5min":11.455,"15min":11.455},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.294,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":11.430999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.1459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":105287680,"data_stored":105283225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80125952,"data_stored":80117983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":28709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":32854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":36935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:25:35.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:25:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 Processor -- start 2024-03-18T18:25:36.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 -- start start 2024-03-18T18:25:36.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f232013e210 0x7f232013e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:36.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f232014cbf0 0x7f232014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:36.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2320070560 con 0x7f23200b13a0 2024-03-18T18:25:36.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200b3790 con 0x7f232014cbf0 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23269f6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200b1780 con 0x7f232013e210 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23261f5700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f232014cbf0 0x7f232014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23261f5700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f232014cbf0 0x7f232014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54700/0 (socket says 172.21.15.94:54700) 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.039+0000 7f23261f5700 1 -- 172.21.15.94:0/4275574908 learned_addr learned my addr 172.21.15.94:0/4275574908 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23251f3700 1 --2- 172.21.15.94:0/4275574908 >> v2:172.21.15.151:3300/0 conn(0x7f232013e210 0x7f232013e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23261f5700 1 -- 172.21.15.94:0/4275574908 >> v2:172.21.15.151:3300/0 conn(0x7f232013e210 msgr2=0x7f232013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23261f5700 1 --2- 172.21.15.94:0/4275574908 >> v2:172.21.15.151:3300/0 conn(0x7f232013e210 0x7f232013e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23261f5700 1 -- 172.21.15.94:0/4275574908 >> v1:172.21.15.151:6789/0 conn(0x7f23200b13a0 legacy=0x7f2320144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23261f5700 1 -- 172.21.15.94:0/4275574908 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200b3a30 con 0x7f232014cbf0 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23251f3700 1 --2- 172.21.15.94:0/4275574908 >> v2:172.21.15.151:3300/0 conn(0x7f232013e210 0x7f232013e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23261f5700 1 --2- 172.21.15.94:0/4275574908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232014cbf0 0x7f232014efe0 secure :-1 s=READY pgs=4489 cs=0 l=1 rev1=1 crypto rx=0x7f2320072df0 tx=0x7f231c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ae1ac4be07433b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23249f2700 1 -- 172.21.15.94:0/4275574908 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00b8a0 con 0x7f232014cbf0 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23249f2700 1 -- 172.21.15.94:0/4275574908 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00ba00 con 0x7f232014cbf0 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23249f2700 1 -- 172.21.15.94:0/4275574908 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00bd90 con 0x7f232014cbf0 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 -- 172.21.15.94:0/4275574908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232014cbf0 msgr2=0x7f232014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:36.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 --2- 172.21.15.94:0/4275574908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232014cbf0 0x7f232014efe0 secure :-1 s=READY pgs=4489 cs=0 l=1 rev1=1 crypto rx=0x7f2320072df0 tx=0x7f231c009bf0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 -- 172.21.15.94:0/4275574908 shutdown_connections 2024-03-18T18:25:36.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 --2- 172.21.15.94:0/4275574908 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232014cbf0 0x7f232014efe0 unknown :-1 s=CLOSED pgs=4489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 --2- 172.21.15.94:0/4275574908 >> v2:172.21.15.151:3300/0 conn(0x7f232013e210 0x7f232013e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 -- 172.21.15.94:0/4275574908 >> 172.21.15.94:0/4275574908 conn(0x7f23200b7a20 msgr2=0x7f23200b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:36.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 -- 172.21.15.94:0/4275574908 shutdown_connections 2024-03-18T18:25:36.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 -- 172.21.15.94:0/4275574908 wait complete. 2024-03-18T18:25:36.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 Processor -- start 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 -- start start 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.043+0000 7f23269f6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23200b13a0 0x7f2320137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 0x7f232013f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f232014cbf0 0x7f2320135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232013ec70 con 0x7f232013e210 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232013f8e0 con 0x7f232014cbf0 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320141900 con 0x7f23200b13a0 2024-03-18T18:25:36.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 0x7f232013f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 0x7f232013f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54702/0 (socket says 172.21.15.94:54702) 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 -- 172.21.15.94:0/479983993 learned_addr learned my addr 172.21.15.94:0/479983993 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23259f4700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23200b13a0 0x7f2320137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23261f5700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f232014cbf0 0x7f2320135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 -- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23200b13a0 msgr2=0x7f2320137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23200b13a0 0x7f2320137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 -- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f232014cbf0 msgr2=0x7f2320135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:36.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f232014cbf0 0x7f2320135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 -- 172.21.15.94:0/479983993 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009570 con 0x7f232013e210 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23251f3700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 0x7f232013f3a0 secure :-1 s=READY pgs=4490 cs=0 l=1 rev1=1 crypto rx=0x7f231000e760 tx=0x7f231000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000c070 con 0x7f232013e210 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310004250 con 0x7f232013e210 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232013ee80 con 0x7f232013e210 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100036c0 con 0x7f232013e210 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320141ea0 con 0x7f232013e210 2024-03-18T18:25:36.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232006fd70 con 0x7f232013e210 2024-03-18T18:25:36.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.047+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2310003820 con 0x7f232013e210 2024-03-18T18:25:36.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.051+0000 7f23167fc700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2304066760 0x7f2304068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:36.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.051+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2310083e70 con 0x7f232013e210 2024-03-18T18:25:36.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.051+0000 7f23259f4700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2304066760 0x7f2304068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:36.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.051+0000 7f23259f4700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2304066760 0x7f2304068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23180012e0 tx=0x7f2318009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:36.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.059+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2310051130 con 0x7f232013e210 2024-03-18T18:25:36.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.227+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2320074440 con 0x7f232013e210 2024-03-18T18:25:36.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.227+0000 7f23167fc700 1 -- 172.21.15.94:0/479983993 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16396 (secure 0 0 0) 0x7f23100094e0 con 0x7f232013e210 2024-03-18T18:25:36.231 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:36.232 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":55,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:25:32.737553+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":64,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":60,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:25:36.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2304066760 msgr2=0x7f2304068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:36.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2304066760 0x7f2304068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23180012e0 tx=0x7f2318009040 comp rx=0 tx=0).stop 2024-03-18T18:25:36.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 msgr2=0x7f232013f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 0x7f232013f3a0 secure :-1 s=READY pgs=4490 cs=0 l=1 rev1=1 crypto rx=0x7f231000e760 tx=0x7f231000ea70 comp rx=0 tx=0).stop 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 shutdown_connections 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2304066760 0x7f2304068c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f232014cbf0 0x7f2320135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232013e210 0x7f232013f3a0 unknown :-1 s=CLOSED pgs=4490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 --2- 172.21.15.94:0/479983993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23200b13a0 0x7f2320137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 >> 172.21.15.94:0/479983993 conn(0x7f23200b7a20 msgr2=0x7f23200b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:36.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 shutdown_connections 2024-03-18T18:25:36.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:36.235+0000 7f23269f6700 1 -- 172.21.15.94:0/479983993 wait complete. 2024-03-18T18:25:37.252 INFO:tasks.ceph:Scrubbing osd.0 2024-03-18T18:25:37.252 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:37.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.379+0000 7fea1e46a700 1 Processor -- start 2024-03-18T18:25:37.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.379+0000 7fea1e46a700 1 -- start start 2024-03-18T18:25:37.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fea1809e4e0 0x7fea181404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea1814a3b0 0x7fea18150df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1809e8c0 con 0x7fea180999d0 2024-03-18T18:25:37.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180bb1e0 con 0x7fea1809e4e0 2024-03-18T18:25:37.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180bb4c0 con 0x7fea1814a3b0 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fea1809e4e0 0x7fea181404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fea1809e4e0 0x7fea181404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54714/0 (socket says 172.21.15.94:54714) 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 -- 172.21.15.94:0/2912885160 learned_addr learned my addr 172.21.15.94:0/2912885160 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1dc69700 1 --2- 172.21.15.94:0/2912885160 >> v2:172.21.15.151:3300/0 conn(0x7fea1814a3b0 0x7fea18150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 -- 172.21.15.94:0/2912885160 >> v2:172.21.15.151:3300/0 conn(0x7fea1814a3b0 msgr2=0x7fea18150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 --2- 172.21.15.94:0/2912885160 >> v2:172.21.15.151:3300/0 conn(0x7fea1814a3b0 0x7fea18150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 -- 172.21.15.94:0/2912885160 >> v1:172.21.15.151:6789/0 conn(0x7fea180999d0 legacy=0x7fea18149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 -- 172.21.15.94:0/2912885160 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180bb7a0 con 0x7fea1809e4e0 2024-03-18T18:25:37.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1d468700 1 --2- 172.21.15.94:0/2912885160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181404e0 secure :-1 s=READY pgs=4491 cs=0 l=1 rev1=1 crypto rx=0x7fea180b8860 tx=0x7fea14009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a787c8c4e9877b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea0bfff700 1 -- 172.21.15.94:0/2912885160 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011830 con 0x7fea1809e4e0 2024-03-18T18:25:37.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea0bfff700 1 -- 172.21.15.94:0/2912885160 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14011990 con 0x7fea1809e4e0 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea0bfff700 1 -- 172.21.15.94:0/2912885160 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011d20 con 0x7fea1809e4e0 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- 172.21.15.94:0/2912885160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 msgr2=0x7fea181404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 --2- 172.21.15.94:0/2912885160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181404e0 secure :-1 s=READY pgs=4491 cs=0 l=1 rev1=1 crypto rx=0x7fea180b8860 tx=0x7fea14009bf0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- 172.21.15.94:0/2912885160 shutdown_connections 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 --2- 172.21.15.94:0/2912885160 >> v2:172.21.15.151:3300/0 conn(0x7fea1814a3b0 0x7fea18150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 --2- 172.21.15.94:0/2912885160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181404e0 unknown :-1 s=CLOSED pgs=4491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- 172.21.15.94:0/2912885160 >> 172.21.15.94:0/2912885160 conn(0x7fea18073600 msgr2=0x7fea1809db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:37.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- 172.21.15.94:0/2912885160 shutdown_connections 2024-03-18T18:25:37.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.383+0000 7fea1e46a700 1 -- 172.21.15.94:0/2912885160 wait complete. 2024-03-18T18:25:37.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 Processor -- start 2024-03-18T18:25:37.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- start start 2024-03-18T18:25:37.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea180999d0 0x7fea181463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181df050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1814a3b0 0x7fea1813d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1809d010 con 0x7fea1809e4e0 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1809bcc0 con 0x7fea180999d0 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18140f20 con 0x7fea1814a3b0 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181df050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181df050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54726/0 (socket says 172.21.15.94:54726) 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 -- 172.21.15.94:0/1180458142 learned_addr learned my addr 172.21.15.94:0/1180458142 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1d468700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea180999d0 0x7fea181463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1dc69700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1814a3b0 0x7fea1813d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 -- 172.21.15.94:0/1180458142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1814a3b0 msgr2=0x7fea1813d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea1814a3b0 0x7fea1813d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 -- 172.21.15.94:0/1180458142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea180999d0 msgr2=0x7fea181463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea180999d0 0x7fea181463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 -- 172.21.15.94:0/1180458142 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009570 con 0x7fea1809e4e0 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1cc67700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181df050 secure :-1 s=READY pgs=4492 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c500 tx=0x7fea0c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0052d0 con 0x7fea1809e4e0 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c005430 con 0x7fea1809e4e0 2024-03-18T18:25:37.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea181411c0 con 0x7fea1809e4e0 2024-03-18T18:25:37.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0055a0 con 0x7fea1809e4e0 2024-03-18T18:25:37.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea181421b0 con 0x7fea1809e4e0 2024-03-18T18:25:37.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.387+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea180bac50 con 0x7fea1809e4e0 2024-03-18T18:25:37.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fea0c0038e0 con 0x7fea1809e4e0 2024-03-18T18:25:37.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea09ffb700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe9fc066730 0x7fe9fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fea0c083d90 con 0x7fea1809e4e0 2024-03-18T18:25:37.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea1d468700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe9fc066730 0x7fe9fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea09ffb700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fe9fc06eb30 0x7fe9fc070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 --> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9fc0716a0 con 0x7fe9fc06eb30 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea0c084100 con 0x7fea1809e4e0 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea1dc69700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fe9fc06eb30 0x7fe9fc070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea1d468700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe9fc066730 0x7fe9fc068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea14000c00 tx=0x7fea14008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.391+0000 7fea1dc69700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fe9fc06eb30 0x7fe9fc070fd0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.395+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== osd.0 v2:172.21.15.94:6800/26022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fe9fc0716a0 con 0x7fe9fc06eb30 2024-03-18T18:25:37.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 --> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea18074440 con 0x7fe9fc06eb30 2024-03-18T18:25:37.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea09ffb700 1 -- 172.21.15.94:0/1180458142 <== osd.0 v2:172.21.15.94:6800/26022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fea18074440 con 0x7fe9fc06eb30 2024-03-18T18:25:37.414 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:37.414 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:37.414 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fe9fc06eb30 msgr2=0x7fe9fc070fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6800/26022,v1:172.21.15.94:6801/26022] conn(0x7fe9fc06eb30 0x7fe9fc070fd0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe9fc066730 msgr2=0x7fe9fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe9fc066730 0x7fe9fc068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea14000c00 tx=0x7fea14008030 comp rx=0 tx=0).stop 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 msgr2=0x7fea181df050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 --2- 172.21.15.94:0/1180458142 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fea1809e4e0 0x7fea181df050 secure :-1 s=READY pgs=4492 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c500 tx=0x7fea0c00c810 comp rx=0 tx=0).stop 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1dc69700 1 -- 172.21.15.94:0/1180458142 reap_dead start 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 shutdown_connections 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 >> 172.21.15.94:0/1180458142 conn(0x7fea18073600 msgr2=0x7fea1813f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 shutdown_connections 2024-03-18T18:25:37.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.411+0000 7fea1e46a700 1 -- 172.21.15.94:0/1180458142 wait complete. 2024-03-18T18:25:37.432 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-18T18:25:37.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 Processor -- start 2024-03-18T18:25:37.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 -- start start 2024-03-18T18:25:37.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f784806a3c0 0x7f7848146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f78480b6c80 0x7f78480b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480b8590 con 0x7f784809d630 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480b7620 con 0x7f784806a3c0 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784759e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78481472c0 con 0x7f78480b6c80 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f784806a3c0 0x7f7848146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f784806a3c0 0x7f7848146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54738/0 (socket says 172.21.15.94:54738) 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 -- 172.21.15.94:0/1304284844 learned_addr learned my addr 172.21.15.94:0/1304284844 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f7845d9b700 1 --2- 172.21.15.94:0/1304284844 >> v2:172.21.15.151:3300/0 conn(0x7f78480b6c80 0x7f78480b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 -- 172.21.15.94:0/1304284844 >> v2:172.21.15.151:3300/0 conn(0x7f78480b6c80 msgr2=0x7f78480b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:37.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 --2- 172.21.15.94:0/1304284844 >> v2:172.21.15.151:3300/0 conn(0x7f78480b6c80 0x7f78480b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 -- 172.21.15.94:0/1304284844 >> v1:172.21.15.151:6789/0 conn(0x7f784809d630 legacy=0x7f784809da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 -- 172.21.15.94:0/1304284844 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784809bb60 con 0x7f784806a3c0 2024-03-18T18:25:37.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784659c700 1 --2- 172.21.15.94:0/1304284844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f784806a3c0 0x7f7848146690 secure :-1 s=READY pgs=4493 cs=0 l=1 rev1=1 crypto rx=0x7f78480b9920 tx=0x7f783c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995251b6f19eacb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784559a700 1 -- 172.21.15.94:0/1304284844 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c011830 con 0x7f784806a3c0 2024-03-18T18:25:37.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784559a700 1 -- 172.21.15.94:0/1304284844 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c011990 con 0x7f784806a3c0 2024-03-18T18:25:37.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.551+0000 7f784559a700 1 -- 172.21.15.94:0/1304284844 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c011d20 con 0x7f784806a3c0 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- 172.21.15.94:0/1304284844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f784806a3c0 msgr2=0x7f7848146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 --2- 172.21.15.94:0/1304284844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f784806a3c0 0x7f7848146690 secure :-1 s=READY pgs=4493 cs=0 l=1 rev1=1 crypto rx=0x7f78480b9920 tx=0x7f783c009bf0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- 172.21.15.94:0/1304284844 shutdown_connections 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 --2- 172.21.15.94:0/1304284844 >> v2:172.21.15.151:3300/0 conn(0x7f78480b6c80 0x7f78480b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 --2- 172.21.15.94:0/1304284844 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f784806a3c0 0x7f7848146690 unknown :-1 s=CLOSED pgs=4493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- 172.21.15.94:0/1304284844 >> 172.21.15.94:0/1304284844 conn(0x7f78480bbda0 msgr2=0x7f78480bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:37.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- 172.21.15.94:0/1304284844 shutdown_connections 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- 172.21.15.94:0/1304284844 wait complete. 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 Processor -- start 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- start start 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784806a3c0 0x7f7848145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784809d630 0x7f78481df670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 0x7f78481408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480b5d40 con 0x7f78480b6c80 2024-03-18T18:25:37.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481dee70 con 0x7f784809d630 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78481df150 con 0x7f784806a3c0 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 0x7f78481408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 0x7f78481408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54754/0 (socket says 172.21.15.94:54754) 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 -- 172.21.15.94:0/2734837624 learned_addr learned my addr 172.21.15.94:0/2734837624 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7845d9b700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784809d630 0x7f78481df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784659c700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784806a3c0 0x7f7848145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 -- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784806a3c0 msgr2=0x7f7848145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784806a3c0 0x7f7848145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 -- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784809d630 msgr2=0x7f78481df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784809d630 0x7f78481df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 -- 172.21.15.94:0/2734837624 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c009570 con 0x7f78480b6c80 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7846d9d700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 0x7f78481408f0 secure :-1 s=READY pgs=4494 cs=0 l=1 rev1=1 crypto rx=0x7f784000cc50 tx=0x7f784000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840003c20 con 0x7f78480b6c80 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840003d80 con 0x7f78480b6c80 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.555+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7848146860 con 0x7f78480b6c80 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000aab0 con 0x7f78480b6c80 2024-03-18T18:25:37.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480b30a0 con 0x7f78480b6c80 2024-03-18T18:25:37.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78480b2c60 con 0x7f78480b6c80 2024-03-18T18:25:37.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f784000ac10 con 0x7f78480b6c80 2024-03-18T18:25:37.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f7836ffd700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7828066760 0x7f7828068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f7840084260 con 0x7f78480b6c80 2024-03-18T18:25:37.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f784659c700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7828066760 0x7f7828068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.559+0000 7f784659c700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7828066760 0x7f7828068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f783c000c00 tx=0x7f783c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.567+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f78400514a0 con 0x7f78480b6c80 2024-03-18T18:25:37.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.735+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f78480b3260 con 0x7f7828066760 2024-03-18T18:25:37.740 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f7836ffd700 1 -- 172.21.15.94:0/2734837624 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f78480b3260 con 0x7f7828066760 2024-03-18T18:25:37.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7828066760 msgr2=0x7f7828068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7828066760 0x7f7828068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f783c000c00 tx=0x7f783c008030 comp rx=0 tx=0).stop 2024-03-18T18:25:37.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 msgr2=0x7f78481408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.743 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 0x7f78481408f0 secure :-1 s=READY pgs=4494 cs=0 l=1 rev1=1 crypto rx=0x7f784000cc50 tx=0x7f784000cf60 comp rx=0 tx=0).stop 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 shutdown_connections 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7828066760 0x7f7828068c20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78480b6c80 0x7f78481408f0 unknown :-1 s=CLOSED pgs=4494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784809d630 0x7f78481df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 --2- 172.21.15.94:0/2734837624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784806a3c0 0x7f7848145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 >> 172.21.15.94:0/2734837624 conn(0x7f78480bbda0 msgr2=0x7f78480b8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 shutdown_connections 2024-03-18T18:25:37.744 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.739+0000 7f784759e700 1 -- 172.21.15.94:0/2734837624 wait complete. 2024-03-18T18:25:37.745 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-03-18T18:25:37.757 INFO:tasks.ceph:Scrubbing osd.1 2024-03-18T18:25:37.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:37.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 Processor -- start 2024-03-18T18:25:37.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- start start 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd9800b8c30 0x7fd980149f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd9801440b0 0x7fd98014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9800b9010 con 0x7fd98009b470 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd980144520 con 0x7fd9800b8c30 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800bbb80 con 0x7fd9801440b0 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd9800b8c30 0x7fd980149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9851b5700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd98009b470 0x7fd9801439a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39814/0 (socket says 172.21.15.94:39814) 2024-03-18T18:25:37.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd9800b8c30 0x7fd980149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54756/0 (socket says 172.21.15.94:54756) 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9851b5700 1 -- 172.21.15.94:0/3314237778 learned_addr learned my addr 172.21.15.94:0/3314237778 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9861b7700 1 --2- 172.21.15.94:0/3314237778 >> v2:172.21.15.151:3300/0 conn(0x7fd9801440b0 0x7fd98014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 -- 172.21.15.94:0/3314237778 >> v2:172.21.15.151:3300/0 conn(0x7fd9801440b0 msgr2=0x7fd98014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 --2- 172.21.15.94:0/3314237778 >> v2:172.21.15.151:3300/0 conn(0x7fd9801440b0 0x7fd98014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 -- 172.21.15.94:0/3314237778 >> v1:172.21.15.94:6789/0 conn(0x7fd98009b470 legacy=0x7fd9801439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 -- 172.21.15.94:0/3314237778 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800b9d50 con 0x7fd9800b8c30 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9861b7700 1 --2- 172.21.15.94:0/3314237778 >> v2:172.21.15.151:3300/0 conn(0x7fd9801440b0 0x7fd98014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:25:37.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9859b6700 1 --2- 172.21.15.94:0/3314237778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd980149f30 secure :-1 s=READY pgs=4496 cs=0 l=1 rev1=1 crypto rx=0x7fd980146810 tx=0x7fd974009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45de3de36bea9c87 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9849b4700 1 -- 172.21.15.94:0/3314237778 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011830 con 0x7fd9800b8c30 2024-03-18T18:25:37.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9849b4700 1 -- 172.21.15.94:0/3314237778 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974011990 con 0x7fd9800b8c30 2024-03-18T18:25:37.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9849b4700 1 -- 172.21.15.94:0/3314237778 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011d40 con 0x7fd9800b8c30 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- 172.21.15.94:0/3314237778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 msgr2=0x7fd980149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 --2- 172.21.15.94:0/3314237778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd980149f30 secure :-1 s=READY pgs=4496 cs=0 l=1 rev1=1 crypto rx=0x7fd980146810 tx=0x7fd974009b30 comp rx=0 tx=0).stop 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- 172.21.15.94:0/3314237778 shutdown_connections 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 --2- 172.21.15.94:0/3314237778 >> v2:172.21.15.151:3300/0 conn(0x7fd9801440b0 0x7fd98014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 --2- 172.21.15.94:0/3314237778 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd980149f30 unknown :-1 s=CLOSED pgs=4496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- 172.21.15.94:0/3314237778 >> 172.21.15.94:0/3314237778 conn(0x7fd98009dc60 msgr2=0x7fd98009e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- 172.21.15.94:0/3314237778 shutdown_connections 2024-03-18T18:25:37.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.863+0000 7fd9869b8700 1 -- 172.21.15.94:0/3314237778 wait complete. 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 Processor -- start 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 -- start start 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd98009b470 0x7fd9801db820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd98009fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9801440b0 0x7fd98009f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800a1c80 con 0x7fd9800b8c30 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800a0980 con 0x7fd9801440b0 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800a0c80 con 0x7fd98009b470 2024-03-18T18:25:37.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd98009fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd98009fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54772/0 (socket says 172.21.15.94:54772) 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 -- 172.21.15.94:0/1739086042 learned_addr learned my addr 172.21.15.94:0/1739086042 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9859b6700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd98009b470 0x7fd9801db820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9861b7700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9801440b0 0x7fd98009f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 -- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd98009b470 msgr2=0x7fd9801db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd98009b470 0x7fd9801db820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 -- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9801440b0 msgr2=0x7fd98009f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9801440b0 0x7fd98009f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 -- 172.21.15.94:0/1739086042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740094b0 con 0x7fd9800b8c30 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9861b7700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9801440b0 0x7fd98009f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9859b6700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd98009b470 0x7fd9801db820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9851b5700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd98009fce0 secure :-1 s=READY pgs=4497 cs=0 l=1 rev1=1 crypto rx=0x7fd97000cba0 tx=0x7fd97000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000a9e0 con 0x7fd9800b8c30 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97000ab40 con 0x7fd9800b8c30 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9800a0f60 con 0x7fd9800b8c30 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970012400 con 0x7fd9800b8c30 2024-03-18T18:25:37.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.867+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9801dc690 con 0x7fd9800b8c30 2024-03-18T18:25:37.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd980099e50 con 0x7fd9800b8c30 2024-03-18T18:25:37.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd97001b3b0 con 0x7fd9800b8c30 2024-03-18T18:25:37.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd97e7fc700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd96c066730 0x7fd96c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd970083ae0 con 0x7fd9800b8c30 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd9859b6700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd96c066730 0x7fd96c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd97e7fc700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fd96c06eab0 0x7fd96c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 --> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd96c071620 con 0x7fd96c06eab0 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9700882c0 con 0x7fd9800b8c30 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd9861b7700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fd96c06eab0 0x7fd96c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd9859b6700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd96c066730 0x7fd96c068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd974009b70 tx=0x7fd974008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.871+0000 7fd9861b7700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fd96c06eab0 0x7fd96c070f50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:37.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.875+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== osd.1 v2:172.21.15.94:6808/26023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd96c071620 con 0x7fd96c06eab0 2024-03-18T18:25:37.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.887+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 --> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd9800a0df0 con 0x7fd96c06eab0 2024-03-18T18:25:37.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd97e7fc700 1 -- 172.21.15.94:0/1739086042 <== osd.1 v2:172.21.15.94:6808/26023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd9800a0df0 con 0x7fd96c06eab0 2024-03-18T18:25:37.892 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:37.892 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:37.893 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:37.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fd96c06eab0 msgr2=0x7fd96c070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6808/26023,v1:172.21.15.94:6810/26023] conn(0x7fd96c06eab0 0x7fd96c070f50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:37.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd96c066730 msgr2=0x7fd96c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd96c066730 0x7fd96c068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd974009b70 tx=0x7fd974008030 comp rx=0 tx=0).stop 2024-03-18T18:25:37.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 msgr2=0x7fd98009fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:37.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 --2- 172.21.15.94:0/1739086042 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd9800b8c30 0x7fd98009fce0 secure :-1 s=READY pgs=4497 cs=0 l=1 rev1=1 crypto rx=0x7fd97000cba0 tx=0x7fd97000cc80 comp rx=0 tx=0).stop 2024-03-18T18:25:37.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9861b7700 1 -- 172.21.15.94:0/1739086042 reap_dead start 2024-03-18T18:25:37.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 shutdown_connections 2024-03-18T18:25:37.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 >> 172.21.15.94:0/1739086042 conn(0x7fd98009dc60 msgr2=0x7fd980144f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:37.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 shutdown_connections 2024-03-18T18:25:37.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:37.891+0000 7fd9869b8700 1 -- 172.21.15.94:0/1739086042 wait complete. 2024-03-18T18:25:37.905 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-18T18:25:38.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e6bfc700 1 Processor -- start 2024-03-18T18:25:38.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e6bfc700 1 -- start start 2024-03-18T18:25:38.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e6bfc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f31e0071e10 0x7f31e0150380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e6bfc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e006ed90 con 0x7f31e00b8480 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e6bfc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e006efd0 con 0x7f31e0071960 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e6bfc700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00b1eb0 con 0x7f31e0071e10 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e5bfa700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f31e00b8480 0x7f31e0144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39824/0 (socket says 172.21.15.94:39824) 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e5bfa700 1 -- 172.21.15.94:0/2674177297 learned_addr learned my addr 172.21.15.94:0/2674177297 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e63fb700 1 --2- 172.21.15.94:0/2674177297 >> v2:172.21.15.94:3300/0 conn(0x7f31e0071e10 0x7f31e0150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e63fb700 1 -- 172.21.15.94:0/2674177297 >> v1:172.21.15.151:6789/0 conn(0x7f31e0071960 legacy=0x7f31e014cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e63fb700 1 -- 172.21.15.94:0/2674177297 >> v1:172.21.15.94:6789/0 conn(0x7f31e00b8480 legacy=0x7f31e0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e63fb700 1 -- 172.21.15.94:0/2674177297 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00b8860 con 0x7f31e0071e10 2024-03-18T18:25:38.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.015+0000 7f31e63fb700 1 --2- 172.21.15.94:0/2674177297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0071e10 0x7f31e0150380 secure :-1 s=READY pgs=4499 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009850 tx=0x7f31d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb096901c178658 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e4bf8700 1 -- 172.21.15.94:0/2674177297 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0011830 con 0x7f31e0071e10 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e4bf8700 1 -- 172.21.15.94:0/2674177297 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0011990 con 0x7f31e0071e10 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e4bf8700 1 -- 172.21.15.94:0/2674177297 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0011d20 con 0x7f31e0071e10 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- 172.21.15.94:0/2674177297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0071e10 msgr2=0x7f31e0150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/2674177297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0071e10 0x7f31e0150380 secure :-1 s=READY pgs=4499 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009850 tx=0x7f31d0009b60 comp rx=0 tx=0).stop 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- 172.21.15.94:0/2674177297 shutdown_connections 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/2674177297 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e0071e10 0x7f31e0150380 unknown :-1 s=CLOSED pgs=4499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- 172.21.15.94:0/2674177297 >> 172.21.15.94:0/2674177297 conn(0x7f31e006a780 msgr2=0x7f31e00b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- 172.21.15.94:0/2674177297 shutdown_connections 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- 172.21.15.94:0/2674177297 wait complete. 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 Processor -- start 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- start start 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0071960 0x7f31e01dd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31e0071e10 0x7f31e013f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 0x7f31e00aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01dd230 con 0x7f31e00b8480 2024-03-18T18:25:38.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0141e10 con 0x7f31e0071960 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e6bfc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0141010 con 0x7f31e0071e10 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 0x7f31e00aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 0x7f31e00aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54786/0 (socket says 172.21.15.94:54786) 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 -- 172.21.15.94:0/1133556876 learned_addr learned my addr 172.21.15.94:0/1133556876 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e53f9700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31e0071e10 0x7f31e013f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e5bfa700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0071960 0x7f31e01dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 -- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31e0071e10 msgr2=0x7f31e013f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31e0071e10 0x7f31e013f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 -- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0071960 msgr2=0x7f31e01dd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0071960 0x7f31e01dd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.019+0000 7f31e63fb700 1 -- 172.21.15.94:0/1133556876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00094b0 con 0x7f31e00b8480 2024-03-18T18:25:38.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31e63fb700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 0x7f31e00aa390 secure :-1 s=READY pgs=4500 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009fd0 tx=0x7f31d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00036c0 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0003820 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003bb0 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e00aa8d0 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e00aae60 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e01dd370 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f31d0021070 con 0x7f31e00b8480 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.023+0000 7f31de7fc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f31cc066730 0x7f31cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.027+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f31d00857a0 con 0x7f31e00b8480 2024-03-18T18:25:38.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.027+0000 7f31e5bfa700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f31cc066730 0x7f31cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.027+0000 7f31e5bfa700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f31cc066730 0x7f31cc068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f31d4005930 tx=0x7f31d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.035+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f31e01dd370 con 0x7f31e00b8480 2024-03-18T18:25:38.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.203+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e006ffe0 con 0x7f31cc066730 2024-03-18T18:25:38.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.203+0000 7f31de7fc700 1 -- 172.21.15.94:0/1133556876 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f31d40015c0 con 0x7f31cc066730 2024-03-18T18:25:38.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f31cc066730 msgr2=0x7f31cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f31cc066730 0x7f31cc068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f31d4005930 tx=0x7f31d4009040 comp rx=0 tx=0).stop 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 msgr2=0x7f31e00aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 0x7f31e00aa390 secure :-1 s=READY pgs=4500 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009fd0 tx=0x7f31d0004770 comp rx=0 tx=0).stop 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 shutdown_connections 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f31cc066730 0x7f31cc068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31e00b8480 0x7f31e00aa390 unknown :-1 s=CLOSED pgs=4500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31e0071e10 0x7f31e013f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 --2- 172.21.15.94:0/1133556876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0071960 0x7f31e01dd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 >> 172.21.15.94:0/1133556876 conn(0x7f31e006a780 msgr2=0x7f31e0143c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 shutdown_connections 2024-03-18T18:25:38.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.211+0000 7f31e6bfc700 1 -- 172.21.15.94:0/1133556876 wait complete. 2024-03-18T18:25:38.217 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-03-18T18:25:38.228 INFO:tasks.ceph:Scrubbing osd.2 2024-03-18T18:25:38.228 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:38.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.347+0000 7f4211ad7700 1 Processor -- start 2024-03-18T18:25:38.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.347+0000 7f4211ad7700 1 -- start start 2024-03-18T18:25:38.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.347+0000 7f4211ad7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 0x7f420c149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.347+0000 7f4211ad7700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c140bf0 con 0x7f420c0bac50 2024-03-18T18:25:38.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.347+0000 7f4211ad7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c09e8c0 con 0x7f420c09e4e0 2024-03-18T18:25:38.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.347+0000 7f4211ad7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0bb1e0 con 0x7f420c0999d0 2024-03-18T18:25:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f42112d6700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f420c0bac50 0x7f420c150df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39826/0 (socket says 172.21.15.94:39826) 2024-03-18T18:25:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f42112d6700 1 -- 172.21.15.94:0/2224622971 learned_addr learned my addr 172.21.15.94:0/2224622971 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 0x7f420c149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995482102 0 0) 0x7f420c140bf0 con 0x7f420c0bac50 2024-03-18T18:25:38.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f40035d0 con 0x7f420c0bac50 2024-03-18T18:25:38.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494850637 0 0) 0x7f420c09e8c0 con 0x7f420c09e4e0 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f420c140bf0 con 0x7f420c09e4e0 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356228321 0 0) 0x7f41f40035d0 con 0x7f420c0bac50 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 msgr2=0x7f420c149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 0x7f420c149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 >> v1:172.21.15.151:6789/0 conn(0x7f420c09e4e0 legacy=0x7f420c1404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0bb4c0 con 0x7f420c0bac50 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f42040019f0 con 0x7f420c0bac50 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 >> v1:172.21.15.94:6789/0 conn(0x7f420c0bac50 legacy=0x7f420c150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4003be0 0x7f41f4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41f4004870 0x7f41f4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 0x7f41f4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0bb1e0 con 0x7f41f4004870 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f400bae0 con 0x7f41f4003be0 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41f4004870 0x7f41f4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f400bca0 con 0x7f420c0999d0 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4210ad5700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4003be0 0x7f41f4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f42112d6700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 0x7f41f4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 -- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 msgr2=0x7f41f4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c0999d0 0x7f41f4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 -- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4003be0 msgr2=0x7f41f4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4003be0 0x7f41f4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 -- 172.21.15.94:0/2224622971 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40035d0 con 0x7f41f4004870 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420bfff700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41f4004870 0x7f41f4004cf0 secure :-1 s=READY pgs=4502 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009b70 tx=0x7f41f40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd0a81d1a58103d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00e6c0 con 0x7f41f4004870 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc00e820 con 0x7f41f4004870 2024-03-18T18:25:38.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f420b7fe700 1 -- 172.21.15.94:0/2224622971 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00eb90 con 0x7f41f4004870 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4211ad7700 1 -- 172.21.15.94:0/2224622971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41f4004870 msgr2=0x7f41f4004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4211ad7700 1 --2- 172.21.15.94:0/2224622971 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41f4004870 0x7f41f4004cf0 secure :-1 s=READY pgs=4502 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009b70 tx=0x7f41f40058a0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f42112d6700 1 -- 172.21.15.94:0/2224622971 reap_dead start 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4211ad7700 1 -- 172.21.15.94:0/2224622971 shutdown_connections 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4211ad7700 1 -- 172.21.15.94:0/2224622971 >> 172.21.15.94:0/2224622971 conn(0x7f420c073600 msgr2=0x7f420c09db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4211ad7700 1 -- 172.21.15.94:0/2224622971 shutdown_connections 2024-03-18T18:25:38.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.351+0000 7f4211ad7700 1 -- 172.21.15.94:0/2224622971 wait complete. 2024-03-18T18:25:38.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 Processor -- start 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 -- start start 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4004870 0x7f420c09bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c1413e0 0x7f420c1def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420c1df4b0 0x7f420c13bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c144000 con 0x7f420c1df4b0 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1df930 con 0x7f41f4004870 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c141ba0 con 0x7f420c1413e0 2024-03-18T18:25:38.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420c1df4b0 0x7f420c13bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420c1df4b0 0x7f420c13bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54814/0 (socket says 172.21.15.94:54814) 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 -- 172.21.15.94:0/973386737 learned_addr learned my addr 172.21.15.94:0/973386737 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f420bfff700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c1413e0 0x7f420c1def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4210ad5700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4004870 0x7f420c09bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 -- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c1413e0 msgr2=0x7f420c1def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f420c1413e0 0x7f420c1def70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 -- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4004870 msgr2=0x7f420c09bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4004870 0x7f420c09bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 -- 172.21.15.94:0/973386737 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c146b50 con 0x7f420c1df4b0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4210ad5700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41f4004870 0x7f420c09bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42112d6700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420c1df4b0 0x7f420c13bdc0 secure :-1 s=READY pgs=4503 cs=0 l=1 rev1=1 crypto rx=0x7f420c14aaf0 tx=0x7f4204001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204017070 con 0x7f420c1df4b0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420400e9a0 con 0x7f420c1df4b0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c146e30 con 0x7f420c1df4b0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.355+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420400eb30 con 0x7f420c1df4b0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c141820 con 0x7f420c1df4b0 2024-03-18T18:25:38.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f420c149ca0 con 0x7f420c1df4b0 2024-03-18T18:25:38.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f420400ec90 con 0x7f420c1df4b0 2024-03-18T18:25:38.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f42097fa700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f41f8066730 0x7f41f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4204083bb0 con 0x7f420c1df4b0 2024-03-18T18:25:38.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f4210ad5700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f41f8066730 0x7f41f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f42097fa700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f41f806eab0 0x7f41f8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 --> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f8071620 con 0x7f41f806eab0 2024-03-18T18:25:38.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.359+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42040882c0 con 0x7f420c1df4b0 2024-03-18T18:25:38.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.363+0000 7f420bfff700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f41f806eab0 0x7f41f8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.363+0000 7f4210ad5700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f41f8066730 0x7f41f8068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4200000c00 tx=0x7f4200009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.363+0000 7f420bfff700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f41f806eab0 0x7f41f8070f50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.363+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== osd.2 v2:172.21.15.94:6824/26033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f41f8071620 con 0x7f41f806eab0 2024-03-18T18:25:38.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 --> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f420c1469b0 con 0x7f41f806eab0 2024-03-18T18:25:38.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f42097fa700 1 -- 172.21.15.94:0/973386737 <== osd.2 v2:172.21.15.94:6824/26033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f420c1469b0 con 0x7f41f806eab0 2024-03-18T18:25:38.382 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:38.383 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:38.383 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f41f806eab0 msgr2=0x7f41f8070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6824/26033,v1:172.21.15.94:6825/26033] conn(0x7f41f806eab0 0x7f41f8070f50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f41f8066730 msgr2=0x7f41f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f41f8066730 0x7f41f8068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4200000c00 tx=0x7f4200009040 comp rx=0 tx=0).stop 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420c1df4b0 msgr2=0x7f420c13bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 --2- 172.21.15.94:0/973386737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420c1df4b0 0x7f420c13bdc0 secure :-1 s=READY pgs=4503 cs=0 l=1 rev1=1 crypto rx=0x7f420c14aaf0 tx=0x7f4204001ad0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f42112d6700 1 -- 172.21.15.94:0/973386737 reap_dead start 2024-03-18T18:25:38.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 shutdown_connections 2024-03-18T18:25:38.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 >> 172.21.15.94:0/973386737 conn(0x7f420c073600 msgr2=0x7f420c0bbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 shutdown_connections 2024-03-18T18:25:38.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.379+0000 7f4211ad7700 1 -- 172.21.15.94:0/973386737 wait complete. 2024-03-18T18:25:38.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-18T18:25:38.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 Processor -- start 2024-03-18T18:25:38.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 -- start start 2024-03-18T18:25:38.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295800ad10 0x7f29580365c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2958033980 0x7f2958036c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2958029d30 con 0x7f29580c8670 2024-03-18T18:25:38.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295802a010 con 0x7f2958033980 2024-03-18T18:25:38.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2966d2f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580357a0 con 0x7f295800ad10 2024-03-18T18:25:38.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296552c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2958033980 0x7f2958036c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2965d2d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295800ad10 0x7f29580365c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296652e700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f29580c8670 0x7f29580cbc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:42904/0 (socket says 172.21.15.94:42904) 2024-03-18T18:25:38.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296652e700 1 -- 172.21.15.94:0/1699988837 learned_addr learned my addr 172.21.15.94:0/1699988837 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:38.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296552c700 1 -- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295800ad10 msgr2=0x7f29580365c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296552c700 1 --2- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295800ad10 0x7f29580365c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296552c700 1 -- 172.21.15.94:0/1699988837 >> v1:172.21.15.151:6789/0 conn(0x7f29580c8670 legacy=0x7f29580cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296552c700 1 -- 172.21.15.94:0/1699988837 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958035a80 con 0x7f2958033980 2024-03-18T18:25:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f296552c700 1 --2- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2958033980 0x7f2958036c90 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f2954009850 tx=0x7f2954009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a479eabe6e600c78 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2964d2b700 1 -- 172.21.15.94:0/1699988837 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954011830 con 0x7f2958033980 2024-03-18T18:25:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2964d2b700 1 -- 172.21.15.94:0/1699988837 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2954011990 con 0x7f2958033980 2024-03-18T18:25:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.511+0000 7f2964d2b700 1 -- 172.21.15.94:0/1699988837 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954011d40 con 0x7f2958033980 2024-03-18T18:25:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 -- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2958033980 msgr2=0x7f2958036c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 --2- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2958033980 0x7f2958036c90 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f2954009850 tx=0x7f2954009b60 comp rx=0 tx=0).stop 2024-03-18T18:25:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 -- 172.21.15.94:0/1699988837 shutdown_connections 2024-03-18T18:25:38.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 --2- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2958033980 0x7f2958036c90 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 --2- 172.21.15.94:0/1699988837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f295800ad10 0x7f29580365c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 -- 172.21.15.94:0/1699988837 >> 172.21.15.94:0/1699988837 conn(0x7f295803aca0 msgr2=0x7f2958005f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 -- 172.21.15.94:0/1699988837 shutdown_connections 2024-03-18T18:25:38.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 -- 172.21.15.94:0/1699988837 wait complete. 2024-03-18T18:25:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 Processor -- start 2024-03-18T18:25:38.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.515+0000 7f2966d2f700 1 -- start start 2024-03-18T18:25:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 0x7f29580cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2958033980 0x7f29580c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29580c8670 0x7f29580c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295802b420 con 0x7f295800ad10 2024-03-18T18:25:38.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295802c460 con 0x7f29580c8670 2024-03-18T18:25:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295802add0 con 0x7f2958033980 2024-03-18T18:25:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 0x7f29580cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 0x7f29580cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54818/0 (socket says 172.21.15.94:54818) 2024-03-18T18:25:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 -- 172.21.15.94:0/758687950 learned_addr learned my addr 172.21.15.94:0/758687950 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f296552c700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2958033980 0x7f29580c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f296652e700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29580c8670 0x7f29580c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 -- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2958033980 msgr2=0x7f29580c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2958033980 0x7f29580c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 -- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29580c8670 msgr2=0x7f29580c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29580c8670 0x7f29580c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 -- 172.21.15.94:0/758687950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540094b0 con 0x7f295800ad10 2024-03-18T18:25:38.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f296652e700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29580c8670 0x7f29580c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2965d2d700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 0x7f29580cbec0 secure :-1 s=READY pgs=4504 cs=0 l=1 rev1=1 crypto rx=0x7f29600677b0 tx=0x7f29600673e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296008f070 con 0x7f295800ad10 2024-03-18T18:25:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960066160 con 0x7f295800ad10 2024-03-18T18:25:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295802b0b0 con 0x7f295800ad10 2024-03-18T18:25:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296006b850 con 0x7f295800ad10 2024-03-18T18:25:38.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.519+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295802a730 con 0x7f295800ad10 2024-03-18T18:25:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.523+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295802b240 con 0x7f295800ad10 2024-03-18T18:25:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.523+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f296006b9b0 con 0x7f295800ad10 2024-03-18T18:25:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.523+0000 7f29527fc700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2944066760 0x7f2944068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.523+0000 7f296552c700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2944066760 0x7f2944068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.523+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f29600fda60 con 0x7f295800ad10 2024-03-18T18:25:38.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.523+0000 7f296552c700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2944066760 0x7f2944068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29540090b0 tx=0x7f2954008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.531+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f29600cad40 con 0x7f295800ad10 2024-03-18T18:25:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.703+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f295802af40 con 0x7f2944066760 2024-03-18T18:25:38.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.703+0000 7f29527fc700 1 -- 172.21.15.94:0/758687950 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f295802af40 con 0x7f2944066760 2024-03-18T18:25:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2944066760 msgr2=0x7f2944068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2944066760 0x7f2944068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29540090b0 tx=0x7f2954008030 comp rx=0 tx=0).stop 2024-03-18T18:25:38.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 msgr2=0x7f29580cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 0x7f29580cbec0 secure :-1 s=READY pgs=4504 cs=0 l=1 rev1=1 crypto rx=0x7f29600677b0 tx=0x7f29600673e0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 shutdown_connections 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2944066760 0x7f2944068c20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29580c8670 0x7f29580c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2958033980 0x7f29580c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 --2- 172.21.15.94:0/758687950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f295800ad10 0x7f29580cbec0 unknown :-1 s=CLOSED pgs=4504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 >> 172.21.15.94:0/758687950 conn(0x7f295803aca0 msgr2=0x7f29580c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 shutdown_connections 2024-03-18T18:25:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.707+0000 7f2966d2f700 1 -- 172.21.15.94:0/758687950 wait complete. 2024-03-18T18:25:38.711 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-03-18T18:25:38.721 INFO:tasks.ceph:Scrubbing osd.3 2024-03-18T18:25:38.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:38.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2487fff700 1 Processor -- start 2024-03-18T18:25:38.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2487fff700 1 -- start start 2024-03-18T18:25:38.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2487fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f248814a3b0 0x7f2488151e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2487fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2488140bf0 con 0x7f248809e4e0 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2487fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248809e8c0 con 0x7f24880999d0 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2487fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24880bb1e0 con 0x7f248814a3b0 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2486ffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f248809e4e0 0x7f24881404e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39836/0 (socket says 172.21.15.94:39836) 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2486ffd700 1 -- 172.21.15.94:0/283000635 learned_addr learned my addr 172.21.15.94:0/283000635 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f24877fe700 1 --2- 172.21.15.94:0/283000635 >> v2:172.21.15.151:3300/0 conn(0x7f248814a3b0 0x7f2488151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2485ffb700 1 -- 172.21.15.94:0/283000635 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126448458 0 0) 0x7f2488140bf0 con 0x7f248809e4e0 2024-03-18T18:25:38.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f2485ffb700 1 -- 172.21.15.94:0/283000635 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24740035d0 con 0x7f248809e4e0 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f24877fe700 1 -- 172.21.15.94:0/283000635 >> v1:172.21.15.151:6789/0 conn(0x7f24880999d0 legacy=0x7f2488149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f24877fe700 1 -- 172.21.15.94:0/283000635 >> v1:172.21.15.94:6789/0 conn(0x7f248809e4e0 legacy=0x7f24881404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f24877fe700 1 -- 172.21.15.94:0/283000635 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880bb4c0 con 0x7f248814a3b0 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.835+0000 7f24877fe700 1 --2- 172.21.15.94:0/283000635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f2488151e00 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f2480009d90 tx=0x7f248000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c89de4f549d0ec17 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2485ffb700 1 -- 172.21.15.94:0/283000635 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000e070 con 0x7f248814a3b0 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2485ffb700 1 -- 172.21.15.94:0/283000635 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248000bb20 con 0x7f248814a3b0 2024-03-18T18:25:38.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2485ffb700 1 -- 172.21.15.94:0/283000635 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248000be90 con 0x7f248814a3b0 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 -- 172.21.15.94:0/283000635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 msgr2=0x7f2488151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 --2- 172.21.15.94:0/283000635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f2488151e00 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f2480009d90 tx=0x7f248000b330 comp rx=0 tx=0).stop 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 -- 172.21.15.94:0/283000635 shutdown_connections 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 --2- 172.21.15.94:0/283000635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f2488151e00 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 -- 172.21.15.94:0/283000635 >> 172.21.15.94:0/283000635 conn(0x7f2488073600 msgr2=0x7f248809db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 -- 172.21.15.94:0/283000635 shutdown_connections 2024-03-18T18:25:38.842 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 -- 172.21.15.94:0/283000635 wait complete. 2024-03-18T18:25:38.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 Processor -- start 2024-03-18T18:25:38.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.839+0000 7f2487fff700 1 -- start start 2024-03-18T18:25:38.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24880999d0 0x7f24880b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f248809e4e0 0x7f24880b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f24881defe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248813eed0 con 0x7f24880999d0 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248813f770 con 0x7f248814a3b0 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248813f120 con 0x7f248809e4e0 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24880999d0 0x7f24880b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24880999d0 0x7f24880b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54820/0 (socket says 172.21.15.94:54820) 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 -- 172.21.15.94:0/3791315789 learned_addr learned my addr 172.21.15.94:0/3791315789 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f24877fe700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f24881defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f24867fc700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f248809e4e0 0x7f24880b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 -- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f248809e4e0 msgr2=0x7f24880b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f248809e4e0 0x7f24880b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 -- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 msgr2=0x7f24881defe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f24881defe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 -- 172.21.15.94:0/3791315789 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2480009a70 con 0x7f24880999d0 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f24877fe700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f248814a3b0 0x7f24881defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2486ffd700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24880999d0 0x7f24880b36e0 secure :-1 s=READY pgs=4506 cs=0 l=1 rev1=1 crypto rx=0x7f2470001be0 tx=0x7f2470014330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470017070 con 0x7f24880999d0 2024-03-18T18:25:38.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470014bd0 con 0x7f24880999d0 2024-03-18T18:25:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248813f400 con 0x7f24880999d0 2024-03-18T18:25:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470005960 con 0x7f24880999d0 2024-03-18T18:25:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24880b5d50 con 0x7f24880999d0 2024-03-18T18:25:38.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.843+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24880bac50 con 0x7f24880999d0 2024-03-18T18:25:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2470010850 con 0x7f24880999d0 2024-03-18T18:25:38.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f247ffff700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2468066730 0x7f2468068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f24867fc700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2468066730 0x7f2468068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f247008c400 con 0x7f24880999d0 2024-03-18T18:25:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f247ffff700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f246806eab0 0x7f2468070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 --> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2468071620 con 0x7f246806eab0 2024-03-18T18:25:38.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f247008c770 con 0x7f24880999d0 2024-03-18T18:25:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f24877fe700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f246806eab0 0x7f2468070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f24867fc700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2468066730 0x7f2468068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2488148a00 tx=0x7f2478009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.847+0000 7f24877fe700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f246806eab0 0x7f2468070f50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:38.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.851+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== osd.3 v2:172.21.15.94:6809/26024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f2468071620 con 0x7f246806eab0 2024-03-18T18:25:38.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 --> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2488074440 con 0x7f246806eab0 2024-03-18T18:25:38.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f247ffff700 1 -- 172.21.15.94:0/3791315789 <== osd.3 v2:172.21.15.94:6809/26024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2488074440 con 0x7f246806eab0 2024-03-18T18:25:38.870 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:38.871 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:38.871 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f246806eab0 msgr2=0x7f2468070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6809/26024,v1:172.21.15.94:6811/26024] conn(0x7f246806eab0 0x7f2468070f50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2468066730 msgr2=0x7f2468068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f2468066730 0x7f2468068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2488148a00 tx=0x7f2478009040 comp rx=0 tx=0).stop 2024-03-18T18:25:38.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24880999d0 msgr2=0x7f24880b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 --2- 172.21.15.94:0/3791315789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24880999d0 0x7f24880b36e0 secure :-1 s=READY pgs=4506 cs=0 l=1 rev1=1 crypto rx=0x7f2470001be0 tx=0x7f2470014330 comp rx=0 tx=0).stop 2024-03-18T18:25:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f24877fe700 1 -- 172.21.15.94:0/3791315789 reap_dead start 2024-03-18T18:25:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 shutdown_connections 2024-03-18T18:25:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 >> 172.21.15.94:0/3791315789 conn(0x7f2488073600 msgr2=0x7f2488144be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 shutdown_connections 2024-03-18T18:25:38.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.867+0000 7f2487fff700 1 -- 172.21.15.94:0/3791315789 wait complete. 2024-03-18T18:25:38.884 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-18T18:25:39.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 Processor -- start 2024-03-18T18:25:39.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- start start 2024-03-18T18:25:39.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4c4c144f40 0x7f4c4c156280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c0af710 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c0b8860 con 0x7f4c4c0b8480 2024-03-18T18:25:39.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0b0fe0 con 0x7f4c4c144f40 2024-03-18T18:25:39.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4b7fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4c4c0ae9f0 0x7f4c4c144830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39846/0 (socket says 172.21.15.94:39846) 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4b7fe700 1 -- 172.21.15.94:0/2158522662 learned_addr learned my addr 172.21.15.94:0/2158522662 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c50c1f700 1 --2- 172.21.15.94:0/2158522662 >> v2:172.21.15.151:3300/0 conn(0x7f4c4c144f40 0x7f4c4c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4affd700 1 -- 172.21.15.94:0/2158522662 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475070788 0 0) 0x7f4c4c0af710 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4affd700 1 -- 172.21.15.94:0/2158522662 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c340035d0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c50c1f700 1 -- 172.21.15.94:0/2158522662 >> v1:172.21.15.151:6789/0 conn(0x7f4c4c0b8480 legacy=0x7f4c4c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c50c1f700 1 -- 172.21.15.94:0/2158522662 >> v1:172.21.15.94:6789/0 conn(0x7f4c4c0ae9f0 legacy=0x7f4c4c144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c50c1f700 1 -- 172.21.15.94:0/2158522662 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0b43e0 con 0x7f4c4c144f40 2024-03-18T18:25:39.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c50c1f700 1 --2- 172.21.15.94:0/2158522662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c144f40 0x7f4c4c156280 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009d90 tx=0x7f4c4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10fa1f92e675ac8f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4affd700 1 -- 172.21.15.94:0/2158522662 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4400e070 con 0x7f4c4c144f40 2024-03-18T18:25:39.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4affd700 1 -- 172.21.15.94:0/2158522662 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4400bb20 con 0x7f4c4c144f40 2024-03-18T18:25:39.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c4affd700 1 -- 172.21.15.94:0/2158522662 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44012430 con 0x7f4c4c144f40 2024-03-18T18:25:39.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- 172.21.15.94:0/2158522662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c144f40 msgr2=0x7f4c4c156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 --2- 172.21.15.94:0/2158522662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c144f40 0x7f4c4c156280 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f4c44009d90 tx=0x7f4c4400b330 comp rx=0 tx=0).stop 2024-03-18T18:25:39.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- 172.21.15.94:0/2158522662 shutdown_connections 2024-03-18T18:25:39.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 --2- 172.21.15.94:0/2158522662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c144f40 0x7f4c4c156280 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- 172.21.15.94:0/2158522662 >> 172.21.15.94:0/2158522662 conn(0x7f4c4c06a780 msgr2=0x7f4c4c0b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- 172.21.15.94:0/2158522662 shutdown_connections 2024-03-18T18:25:39.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:38.999+0000 7f4c51420700 1 -- 172.21.15.94:0/2158522662 wait complete. 2024-03-18T18:25:39.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 Processor -- start 2024-03-18T18:25:39.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 -- start start 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 0x7f4c4c146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c0b8480 0x7f4c4c1e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c4c144f40 0x7f4c4c1e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c1477f0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c06f080 con 0x7f4c4c0b8480 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c146e90 con 0x7f4c4c144f40 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 0x7f4c4c146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 0x7f4c4c146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54836/0 (socket says 172.21.15.94:54836) 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 -- 172.21.15.94:0/2290420537 learned_addr learned my addr 172.21.15.94:0/2290420537 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4b7fe700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c0b8480 0x7f4c4c1e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c50c1f700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c4c144f40 0x7f4c4c1e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 -- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c4c144f40 msgr2=0x7f4c4c1e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c4c144f40 0x7f4c4c1e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 -- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c0b8480 msgr2=0x7f4c4c1e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c0b8480 0x7f4c4c1e2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 -- 172.21.15.94:0/2290420537 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009a70 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c50c1f700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c4c144f40 0x7f4c4c1e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c4bfff700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 0x7f4c4c146540 secure :-1 s=READY pgs=4508 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c530 tx=0x7f4c4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400052d0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40005430 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c147130 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400055a0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.003+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c06f2f0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.007+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c071fe0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.007+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4c400038e0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.007+0000 7f4c48ff9700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4c38066730 0x7f4c38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.007+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4c400836c0 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.007+0000 7f4c4b7fe700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4c38066730 0x7f4c38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.007+0000 7f4c4b7fe700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4c38066730 0x7f4c38068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c1484b0 tx=0x7f4c3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.015+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4c40050990 con 0x7f4c4c0ae9f0 2024-03-18T18:25:39.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.187+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c4c0b1ef0 con 0x7f4c38066730 2024-03-18T18:25:39.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.187+0000 7f4c48ff9700 1 -- 172.21.15.94:0/2290420537 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4c3c001c70 con 0x7f4c38066730 2024-03-18T18:25:39.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4c38066730 msgr2=0x7f4c38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4c38066730 0x7f4c38068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c1484b0 tx=0x7f4c3c009040 comp rx=0 tx=0).stop 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 msgr2=0x7f4c4c146540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 0x7f4c4c146540 secure :-1 s=READY pgs=4508 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c530 tx=0x7f4c4000c8f0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 shutdown_connections 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4c38066730 0x7f4c38068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c4c144f40 0x7f4c4c1e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c4c0b8480 0x7f4c4c1e2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 --2- 172.21.15.94:0/2290420537 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c4c0ae9f0 0x7f4c4c146540 unknown :-1 s=CLOSED pgs=4508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 >> 172.21.15.94:0/2290420537 conn(0x7f4c4c06a780 msgr2=0x7f4c4c148940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 shutdown_connections 2024-03-18T18:25:39.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.191+0000 7f4c51420700 1 -- 172.21.15.94:0/2290420537 wait complete. 2024-03-18T18:25:39.196 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-03-18T18:25:39.207 INFO:tasks.ceph:Scrubbing osd.4 2024-03-18T18:25:39.207 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:39.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd979773700 1 Processor -- start 2024-03-18T18:25:39.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd979773700 1 -- start start 2024-03-18T18:25:39.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd979773700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97413d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd979773700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd974143730 con 0x7fd97413d660 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd979773700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9740b4e30 con 0x7fd97406f900 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd979773700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740713e0 con 0x7fd974070910 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd978f72700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd97413d660 0x7fd97414dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39848/0 (socket says 172.21.15.94:39848) 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd978f72700 1 -- 172.21.15.94:0/1689302700 learned_addr learned my addr 172.21.15.94:0/1689302700 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd9737fe700 1 --2- 172.21.15.94:0/1689302700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97413d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.323+0000 7fd972ffd700 1 -- 172.21.15.94:0/1689302700 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704451932 0 0) 0x7fd974143730 con 0x7fd97413d660 2024-03-18T18:25:39.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd972ffd700 1 -- 172.21.15.94:0/1689302700 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c0035d0 con 0x7fd97413d660 2024-03-18T18:25:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd9737fe700 1 -- 172.21.15.94:0/1689302700 >> v1:172.21.15.151:6789/0 conn(0x7fd97406f900 legacy=0x7fd974143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd972ffd700 1 -- 172.21.15.94:0/1689302700 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003436940 0 0) 0x7fd9740b4e30 con 0x7fd97406f900 2024-03-18T18:25:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd9737fe700 1 -- 172.21.15.94:0/1689302700 >> v1:172.21.15.94:6789/0 conn(0x7fd97413d660 legacy=0x7fd97414dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd9737fe700 1 -- 172.21.15.94:0/1689302700 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974143400 con 0x7fd974070910 2024-03-18T18:25:39.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd9737fe700 1 --2- 172.21.15.94:0/1689302700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97413d120 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd964009880 tx=0x7fd964009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c734164ebc7bfb03 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd972ffd700 1 -- 172.21.15.94:0/1689302700 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011830 con 0x7fd974070910 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd972ffd700 1 -- 172.21.15.94:0/1689302700 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011990 con 0x7fd974070910 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd972ffd700 1 -- 172.21.15.94:0/1689302700 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011d20 con 0x7fd974070910 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 -- 172.21.15.94:0/1689302700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 msgr2=0x7fd97413d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 --2- 172.21.15.94:0/1689302700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97413d120 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd964009880 tx=0x7fd964009b90 comp rx=0 tx=0).stop 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 -- 172.21.15.94:0/1689302700 shutdown_connections 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 --2- 172.21.15.94:0/1689302700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97413d120 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 -- 172.21.15.94:0/1689302700 >> 172.21.15.94:0/1689302700 conn(0x7fd97406b850 msgr2=0x7fd97406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 -- 172.21.15.94:0/1689302700 shutdown_connections 2024-03-18T18:25:39.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.327+0000 7fd979773700 1 -- 172.21.15.94:0/1689302700 wait complete. 2024-03-18T18:25:39.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 Processor -- start 2024-03-18T18:25:39.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 -- start start 2024-03-18T18:25:39.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97406f900 0x7fd974140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97406a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97413d660 0x7fd974137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974145740 con 0x7fd97413d660 2024-03-18T18:25:39.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974146c60 con 0x7fd97406f900 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97406ca20 con 0x7fd974070910 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97413d660 0x7fd974137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97413d660 0x7fd974137da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54842/0 (socket says 172.21.15.94:54842) 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 -- 172.21.15.94:0/1351201655 learned_addr learned my addr 172.21.15.94:0/1351201655 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd9737fe700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97406a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd973fff700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97406f900 0x7fd974140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 -- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 msgr2=0x7fd97406a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd974070910 0x7fd97406a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 -- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97406f900 msgr2=0x7fd974140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97406f900 0x7fd974140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 -- 172.21.15.94:0/1351201655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640094b0 con 0x7fd97413d660 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd978f72700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97413d660 0x7fd974137da0 secure :-1 s=READY pgs=4510 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00caa0 tx=0x7fd96c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c007480 con 0x7fd97413d660 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974146e90 con 0x7fd97413d660 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9741444b0 con 0x7fd97413d660 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c0075e0 con 0x7fd97413d660 2024-03-18T18:25:39.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.331+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c007970 con 0x7fd97413d660 2024-03-18T18:25:39.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9740b5290 con 0x7fd97413d660 2024-03-18T18:25:39.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd96c01b3b0 con 0x7fd97413d660 2024-03-18T18:25:39.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd970ff9700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd960066730 0x7fd960068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd973fff700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd960066730 0x7fd960068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd96c084330 con 0x7fd97413d660 2024-03-18T18:25:39.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd970ff9700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd96006eab0 0x7fd960070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 --> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd960071620 con 0x7fd96006eab0 2024-03-18T18:25:39.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd96c0846e0 con 0x7fd97413d660 2024-03-18T18:25:39.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd9737fe700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd96006eab0 0x7fd960070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.335+0000 7fd973fff700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd960066730 0x7fd960068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd968007fd0 tx=0x7fd968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.339+0000 7fd9737fe700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd96006eab0 0x7fd960070f50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.339+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== osd.4 v2:172.21.15.151:6822/26215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd960071620 con 0x7fd96006eab0 2024-03-18T18:25:39.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 --> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd974072040 con 0x7fd96006eab0 2024-03-18T18:25:39.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd970ff9700 1 -- 172.21.15.94:0/1351201655 <== osd.4 v2:172.21.15.151:6822/26215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd964011b00 con 0x7fd96006eab0 2024-03-18T18:25:39.361 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:39.361 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:39.361 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:39.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd96006eab0 msgr2=0x7fd960070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.151:6822/26215,v1:172.21.15.151:6823/26215] conn(0x7fd96006eab0 0x7fd960070f50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd960066730 msgr2=0x7fd960068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fd960066730 0x7fd960068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd968007fd0 tx=0x7fd968009040 comp rx=0 tx=0).stop 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97413d660 msgr2=0x7fd974137da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 --2- 172.21.15.94:0/1351201655 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd97413d660 0x7fd974137da0 secure :-1 s=READY pgs=4510 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00caa0 tx=0x7fd96c00cad0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd978f72700 1 -- 172.21.15.94:0/1351201655 reap_dead start 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 shutdown_connections 2024-03-18T18:25:39.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 >> 172.21.15.94:0/1351201655 conn(0x7fd97406b850 msgr2=0x7fd974143bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 shutdown_connections 2024-03-18T18:25:39.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.359+0000 7fd979773700 1 -- 172.21.15.94:0/1351201655 wait complete. 2024-03-18T18:25:39.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-18T18:25:39.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9eb88700 1 Processor -- start 2024-03-18T18:25:39.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9eb88700 1 -- start start 2024-03-18T18:25:39.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9eb88700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 0x7f0e980adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9eb88700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980ad670 con 0x7f0e980b3f80 2024-03-18T18:25:39.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9eb88700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980af2e0 con 0x7f0e980b2500 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9eb88700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980acf20 con 0x7f0e980b8480 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9d385700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0e980b3f80 0x7f0e98149d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39852/0 (socket says 172.21.15.94:39852) 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9d385700 1 -- 172.21.15.94:0/2778566106 learned_addr learned my addr 172.21.15.94:0/2778566106 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9db86700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 0x7f0e980adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946873665 0 0) 0x7f0e980ad670 con 0x7f0e980b3f80 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e800035d0 con 0x7f0e980b3f80 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864875304 0 0) 0x7f0e980af2e0 con 0x7f0e980b2500 2024-03-18T18:25:39.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e980ad670 con 0x7f0e980b2500 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3489371431 0 0) 0x7f0e800035d0 con 0x7f0e980b3f80 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 msgr2=0x7f0e980adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 0x7f0e980adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 >> v1:172.21.15.151:6789/0 conn(0x7f0e980b2500 legacy=0x7f0e9814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9814ab20 con 0x7f0e980b3f80 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.0 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3449807159 0 0) 0x7f0e880019f0 con 0x7f0e980b3f80 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 >> v1:172.21.15.94:6789/0 conn(0x7f0e980b3f80 legacy=0x7f0e98149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e80003be0 0x7f0e80003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 0x7f0e80004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e80004db0 0x7f0e80005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000bb00 con 0x7f0e80004db0 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000bc70 con 0x7f0e80003be0 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8000be30 con 0x7f0e980b8480 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9db86700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e80003be0 0x7f0e80003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9d385700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 0x7f0e80004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.495+0000 7f0e9e387700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e80004db0 0x7f0e80005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 -- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 msgr2=0x7f0e80004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:39.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e980b8480 0x7f0e80004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 -- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e80003be0 msgr2=0x7f0e80003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:39.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e80003be0 0x7f0e80003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 -- 172.21.15.94:0/2778566106 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800035d0 con 0x7f0e80004db0 2024-03-18T18:25:39.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9db86700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e80003be0 0x7f0e80003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e80004db0 0x7f0e80005230 secure :-1 s=READY pgs=4512 cs=0 l=1 rev1=1 crypto rx=0x7f0e90001960 tx=0x7f0e800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b8bb3cbb36ac84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90001450 con 0x7f0e80004db0 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e900052f0 con 0x7f0e80004db0 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9cb84700 1 -- 172.21.15.94:0/2778566106 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900036a0 con 0x7f0e80004db0 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 -- 172.21.15.94:0/2778566106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e80004db0 msgr2=0x7f0e80005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/2778566106 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e80004db0 0x7f0e80005230 secure :-1 s=READY pgs=4512 cs=0 l=1 rev1=1 crypto rx=0x7f0e90001960 tx=0x7f0e800058a0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9e387700 1 -- 172.21.15.94:0/2778566106 reap_dead start 2024-03-18T18:25:39.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 -- 172.21.15.94:0/2778566106 shutdown_connections 2024-03-18T18:25:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 -- 172.21.15.94:0/2778566106 >> 172.21.15.94:0/2778566106 conn(0x7f0e9806a780 msgr2=0x7f0e980b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 -- 172.21.15.94:0/2778566106 shutdown_connections 2024-03-18T18:25:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 -- 172.21.15.94:0/2778566106 wait complete. 2024-03-18T18:25:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 Processor -- start 2024-03-18T18:25:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.499+0000 7f0e9eb88700 1 -- start start 2024-03-18T18:25:39.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 0x7f0e981db8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98121a20 0x7f0e98142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e981431c0 0x7f0e9806f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9811fdc0 con 0x7f0e981498b0 2024-03-18T18:25:39.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98120310 con 0x7f0e981431c0 2024-03-18T18:25:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98120770 con 0x7f0e98121a20 2024-03-18T18:25:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 0x7f0e981db8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 0x7f0e981db8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54854/0 (socket says 172.21.15.94:54854) 2024-03-18T18:25:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 -- 172.21.15.94:0/447268503 learned_addr learned my addr 172.21.15.94:0/447268503 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:39.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9e387700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e981431c0 0x7f0e9806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9d385700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98121a20 0x7f0e98142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 -- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98121a20 msgr2=0x7f0e98142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98121a20 0x7f0e98142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 -- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e981431c0 msgr2=0x7f0e9806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e981431c0 0x7f0e9806f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 -- 172.21.15.94:0/447268503 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98149c90 con 0x7f0e981498b0 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9db86700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 0x7f0e981db8d0 secure :-1 s=READY pgs=4513 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c011ca0 tx=0x7f0e8c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00fab0 con 0x7f0e981498b0 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00fc10 con 0x7f0e981498b0 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e98121f30 con 0x7f0e981498b0 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c004020 con 0x7f0e981498b0 2024-03-18T18:25:39.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e98143640 con 0x7f0e981498b0 2024-03-18T18:25:39.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.503+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e98074440 con 0x7f0e981498b0 2024-03-18T18:25:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.507+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0e8c004180 con 0x7f0e981498b0 2024-03-18T18:25:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.507+0000 7f0e967fc700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0e84066760 0x7f0e84068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.507+0000 7f0e9d385700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0e84066760 0x7f0e84068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.507+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0e8c084be0 con 0x7f0e981498b0 2024-03-18T18:25:39.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.511+0000 7f0e9d385700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0e84066760 0x7f0e84068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0e980afdf0 tx=0x7f0e88006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.515+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0e8c051f30 con 0x7f0e981498b0 2024-03-18T18:25:39.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.679+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e980ad110 con 0x7f0e84066760 2024-03-18T18:25:39.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.683+0000 7f0e967fc700 1 -- 172.21.15.94:0/447268503 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e88007780 con 0x7f0e84066760 2024-03-18T18:25:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0e84066760 msgr2=0x7f0e84068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0e84066760 0x7f0e84068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0e980afdf0 tx=0x7f0e88006040 comp rx=0 tx=0).stop 2024-03-18T18:25:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 msgr2=0x7f0e981db8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 0x7f0e981db8d0 secure :-1 s=READY pgs=4513 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c011ca0 tx=0x7f0e8c009f20 comp rx=0 tx=0).stop 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 shutdown_connections 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f0e84066760 0x7f0e84068c20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e981431c0 0x7f0e9806f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98121a20 0x7f0e98142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 --2- 172.21.15.94:0/447268503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e981498b0 0x7f0e981db8d0 unknown :-1 s=CLOSED pgs=4513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 >> 172.21.15.94:0/447268503 conn(0x7f0e9806a780 msgr2=0x7f0e980665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 shutdown_connections 2024-03-18T18:25:39.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.687+0000 7f0e9eb88700 1 -- 172.21.15.94:0/447268503 wait complete. 2024-03-18T18:25:39.690 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-03-18T18:25:39.705 INFO:tasks.ceph:Scrubbing osd.5 2024-03-18T18:25:39.705 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.819+0000 7f607ddf2700 1 Processor -- start 2024-03-18T18:25:39.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.819+0000 7f607ddf2700 1 -- start start 2024-03-18T18:25:39.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607ddf2700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6078073240 0x7f607806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607ddf2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f607813e7e0 0x7f60781479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607ddf2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780705d0 con 0x7f60780b3e40 2024-03-18T18:25:39.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607ddf2700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607806f3d0 con 0x7f6078073240 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607ddf2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780b1ef0 con 0x7f607813e7e0 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6078073240 0x7f607806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6078073240 0x7f607806ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54870/0 (socket says 172.21.15.94:54870) 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 -- 172.21.15.94:0/2838710126 learned_addr learned my addr 172.21.15.94:0/2838710126 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607d5f1700 1 --2- 172.21.15.94:0/2838710126 >> v2:172.21.15.151:3300/0 conn(0x7f607813e7e0 0x7f60781479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 -- 172.21.15.94:0/2838710126 >> v2:172.21.15.151:3300/0 conn(0x7f607813e7e0 msgr2=0x7f60781479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 --2- 172.21.15.94:0/2838710126 >> v2:172.21.15.151:3300/0 conn(0x7f607813e7e0 0x7f60781479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 -- 172.21.15.94:0/2838710126 >> v1:172.21.15.151:6789/0 conn(0x7f60780b3e40 legacy=0x7f607813e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 -- 172.21.15.94:0/2838710126 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078073620 con 0x7f6078073240 2024-03-18T18:25:39.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f607cdf0700 1 --2- 172.21.15.94:0/2838710126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6078073240 0x7f607806ee90 secure :-1 s=READY pgs=4514 cs=0 l=1 rev1=1 crypto rx=0x7f60780b2800 tx=0x7f6074009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7562311fad8753e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f606f7fe700 1 -- 172.21.15.94:0/2838710126 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011830 con 0x7f6078073240 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f606f7fe700 1 -- 172.21.15.94:0/2838710126 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074011990 con 0x7f6078073240 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.823+0000 7f606f7fe700 1 -- 172.21.15.94:0/2838710126 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011d20 con 0x7f6078073240 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 -- 172.21.15.94:0/2838710126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6078073240 msgr2=0x7f607806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 --2- 172.21.15.94:0/2838710126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6078073240 0x7f607806ee90 secure :-1 s=READY pgs=4514 cs=0 l=1 rev1=1 crypto rx=0x7f60780b2800 tx=0x7f6074009bf0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 -- 172.21.15.94:0/2838710126 shutdown_connections 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 --2- 172.21.15.94:0/2838710126 >> v2:172.21.15.151:3300/0 conn(0x7f607813e7e0 0x7f60781479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 --2- 172.21.15.94:0/2838710126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6078073240 0x7f607806ee90 unknown :-1 s=CLOSED pgs=4514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 -- 172.21.15.94:0/2838710126 >> 172.21.15.94:0/2838710126 conn(0x7f60780b4c90 msgr2=0x7f60780b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 -- 172.21.15.94:0/2838710126 shutdown_connections 2024-03-18T18:25:39.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 -- 172.21.15.94:0/2838710126 wait complete. 2024-03-18T18:25:39.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 Processor -- start 2024-03-18T18:25:39.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.827+0000 7f607ddf2700 1 -- start start 2024-03-18T18:25:39.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6078073240 0x7f60781da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60780b3e40 0x7f60780b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f607813e7e0 0x7f60781dcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781da090 con 0x7f607813e7e0 2024-03-18T18:25:39.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607813f880 con 0x7f6078073240 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6078072420 con 0x7f60780b3e40 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f607813e7e0 0x7f60781dcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f607813e7e0 0x7f60781dcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54878/0 (socket says 172.21.15.94:54878) 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 -- 172.21.15.94:0/183172023 learned_addr learned my addr 172.21.15.94:0/183172023 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f606ffff700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60780b3e40 0x7f60780b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607cdf0700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6078073240 0x7f60781da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 -- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60780b3e40 msgr2=0x7f60780b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60780b3e40 0x7f60780b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 -- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6078073240 msgr2=0x7f60781da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6078073240 0x7f60781da4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 -- 172.21.15.94:0/183172023 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074009570 con 0x7f607813e7e0 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607d5f1700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f607813e7e0 0x7f60781dcf60 secure :-1 s=READY pgs=4515 cs=0 l=1 rev1=1 crypto rx=0x7f607000efc0 tx=0x7f607000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000cad0 con 0x7f607813e7e0 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000f040 con 0x7f607813e7e0 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607813fd60 con 0x7f607813e7e0 2024-03-18T18:25:39.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000ce70 con 0x7f607813e7e0 2024-03-18T18:25:39.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60781d9cb0 con 0x7f607813e7e0 2024-03-18T18:25:39.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.831+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60780b2420 con 0x7f607813e7e0 2024-03-18T18:25:39.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6070014480 con 0x7f607813e7e0 2024-03-18T18:25:39.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606d7fa700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6064066730 0x7f6064068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f607cdf0700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6064066730 0x7f6064068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6070084fc0 con 0x7f607813e7e0 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606d7fa700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f606406eab0 0x7f6064070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 --> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6064071620 con 0x7f606406eab0 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6070085410 con 0x7f607813e7e0 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f607cdf0700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6064066730 0x7f6064068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6074000c00 tx=0x7f6074008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606ffff700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f606406eab0 0x7f6064070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.835+0000 7f606ffff700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f606406eab0 0x7f6064070f50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.839+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== osd.5 v2:172.21.15.151:6808/26217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6064071620 con 0x7f606406eab0 2024-03-18T18:25:39.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 --> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60781d9b10 con 0x7f606406eab0 2024-03-18T18:25:39.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f606d7fa700 1 -- 172.21.15.94:0/183172023 <== osd.5 v2:172.21.15.151:6808/26217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f60781d9b10 con 0x7f606406eab0 2024-03-18T18:25:39.861 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:39.861 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:39.861 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:39.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f606406eab0 msgr2=0x7f6064070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.151:6808/26217,v1:172.21.15.151:6809/26217] conn(0x7f606406eab0 0x7f6064070f50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6064066730 msgr2=0x7f6064068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6064066730 0x7f6064068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6074000c00 tx=0x7f6074008030 comp rx=0 tx=0).stop 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f607813e7e0 msgr2=0x7f60781dcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 --2- 172.21.15.94:0/183172023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f607813e7e0 0x7f60781dcf60 secure :-1 s=READY pgs=4515 cs=0 l=1 rev1=1 crypto rx=0x7f607000efc0 tx=0x7f607000c0c0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607d5f1700 1 -- 172.21.15.94:0/183172023 reap_dead start 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 shutdown_connections 2024-03-18T18:25:39.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 >> 172.21.15.94:0/183172023 conn(0x7f60780b4c90 msgr2=0x7f607813b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 shutdown_connections 2024-03-18T18:25:39.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.859+0000 7f607ddf2700 1 -- 172.21.15.94:0/183172023 wait complete. 2024-03-18T18:25:39.875 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-18T18:25:39.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 Processor -- start 2024-03-18T18:25:39.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 -- start start 2024-03-18T18:25:39.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efc301432b0 0x7efc30143740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc3014bb40 0x7efc3014df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:39.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc30072170 con 0x7efc30071d90 2024-03-18T18:25:39.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc300b8920 con 0x7efc301432b0 2024-03-18T18:25:39.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc300b1600 con 0x7efc3014bb40 2024-03-18T18:25:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2ed9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc3014bb40 0x7efc3014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc25d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efc301432b0 0x7efc30143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2e59c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7efc30071d90 0x7efc300b8210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:42960/0 (socket says 172.21.15.94:42960) 2024-03-18T18:25:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2e59c700 1 -- 172.21.15.94:0/3049236756 learned_addr learned my addr 172.21.15.94:0/3049236756 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:39.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2dd9b700 1 -- 172.21.15.94:0/3049236756 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621873587 0 0) 0x7efc30072170 con 0x7efc30071d90 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2dd9b700 1 -- 172.21.15.94:0/3049236756 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc1c0035d0 con 0x7efc30071d90 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc25d9b700 1 -- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc3014bb40 msgr2=0x7efc3014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc25d9b700 1 --2- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc3014bb40 0x7efc3014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc25d9b700 1 -- 172.21.15.94:0/3049236756 >> v1:172.21.15.151:6789/0 conn(0x7efc30071d90 legacy=0x7efc300b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc25d9b700 1 -- 172.21.15.94:0/3049236756 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3013da50 con 0x7efc301432b0 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc2ed9d700 1 --2- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc3014bb40 0x7efc3014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.991+0000 7efc25d9b700 1 --2- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc301432b0 0x7efc30143740 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7efc18009850 tx=0x7efc18009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7a7d432781cfe44 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:39.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2dd9b700 1 -- 172.21.15.94:0/3049236756 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011830 con 0x7efc301432b0 2024-03-18T18:25:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2dd9b700 1 -- 172.21.15.94:0/3049236756 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc18011990 con 0x7efc301432b0 2024-03-18T18:25:39.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2dd9b700 1 -- 172.21.15.94:0/3049236756 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011d40 con 0x7efc301432b0 2024-03-18T18:25:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 -- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc301432b0 msgr2=0x7efc30143740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 --2- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc301432b0 0x7efc30143740 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7efc18009850 tx=0x7efc18009b60 comp rx=0 tx=0).stop 2024-03-18T18:25:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 -- 172.21.15.94:0/3049236756 shutdown_connections 2024-03-18T18:25:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 --2- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc3014bb40 0x7efc3014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 --2- 172.21.15.94:0/3049236756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc301432b0 0x7efc30143740 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:39.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 -- 172.21.15.94:0/3049236756 >> 172.21.15.94:0/3049236756 conn(0x7efc3006a780 msgr2=0x7efc300b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 -- 172.21.15.94:0/3049236756 shutdown_connections 2024-03-18T18:25:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 -- 172.21.15.94:0/3049236756 wait complete. 2024-03-18T18:25:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 Processor -- start 2024-03-18T18:25:40.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.995+0000 7efc2f59e700 1 -- start start 2024-03-18T18:25:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc30071d90 0x7efc301349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc301432b0 0x7efc300703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 0x7efc300708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3012f870 con 0x7efc3014bb40 2024-03-18T18:25:40.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3012e600 con 0x7efc30071d90 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc30144830 con 0x7efc301432b0 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 0x7efc300708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 0x7efc300708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54890/0 (socket says 172.21.15.94:54890) 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 -- 172.21.15.94:0/4054112857 learned_addr learned my addr 172.21.15.94:0/4054112857 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2e59c700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc30071d90 0x7efc301349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc25d9b700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc301432b0 0x7efc300703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 -- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc301432b0 msgr2=0x7efc300703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc301432b0 0x7efc300703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 -- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc30071d90 msgr2=0x7efc301349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc30071d90 0x7efc301349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 -- 172.21.15.94:0/4054112857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280094b0 con 0x7efc3014bb40 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2ed9d700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 0x7efc300708f0 secure :-1 s=READY pgs=4516 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e990 tx=0x7efc2800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28009710 con 0x7efc3014bb40 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28004020 con 0x7efc3014bb40 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc280043b0 con 0x7efc3014bb40 2024-03-18T18:25:40.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc180094b0 con 0x7efc3014bb40 2024-03-18T18:25:40.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:39.999+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc30144aa0 con 0x7efc3014bb40 2024-03-18T18:25:40.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.003+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efc280036c0 con 0x7efc3014bb40 2024-03-18T18:25:40.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.003+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3012f3f0 con 0x7efc3014bb40 2024-03-18T18:25:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.003+0000 7efc277fe700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7efc10066730 0x7efc10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.003+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7efc28083e70 con 0x7efc3014bb40 2024-03-18T18:25:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.007+0000 7efc2e59c700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7efc10066730 0x7efc10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.007+0000 7efc2e59c700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7efc10066730 0x7efc10068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc20001560 tx=0x7efc20001a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.007+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efc3012f3f0 con 0x7efc3014bb40 2024-03-18T18:25:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.175+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7efc300b4120 con 0x7efc10066730 2024-03-18T18:25:40.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.175+0000 7efc277fe700 1 -- 172.21.15.94:0/4054112857 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efc200077e0 con 0x7efc10066730 2024-03-18T18:25:40.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7efc10066730 msgr2=0x7efc10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7efc10066730 0x7efc10068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc20001560 tx=0x7efc20001a90 comp rx=0 tx=0).stop 2024-03-18T18:25:40.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 msgr2=0x7efc300708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 0x7efc300708f0 secure :-1 s=READY pgs=4516 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e990 tx=0x7efc2800eca0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 shutdown_connections 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7efc10066730 0x7efc10068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efc3014bb40 0x7efc300708f0 unknown :-1 s=CLOSED pgs=4516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc301432b0 0x7efc300703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 --2- 172.21.15.94:0/4054112857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc30071d90 0x7efc301349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 >> 172.21.15.94:0/4054112857 conn(0x7efc3006a780 msgr2=0x7efc300b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 shutdown_connections 2024-03-18T18:25:40.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.179+0000 7efc2f59e700 1 -- 172.21.15.94:0/4054112857 wait complete. 2024-03-18T18:25:40.184 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-03-18T18:25:40.195 INFO:tasks.ceph:Scrubbing osd.6 2024-03-18T18:25:40.195 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.311+0000 7fde8e6d6700 1 Processor -- start 2024-03-18T18:25:40.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.311+0000 7fde8e6d6700 1 -- start start 2024-03-18T18:25:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde880999d0 0x7fde88149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880bac50 0x7fde8814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde88140bf0 con 0x7fde8809e4e0 2024-03-18T18:25:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8809e8c0 con 0x7fde880999d0 2024-03-18T18:25:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde880bb1e0 con 0x7fde880bac50 2024-03-18T18:25:40.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde880999d0 0x7fde88149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde880999d0 0x7fde88149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54900/0 (socket says 172.21.15.94:54900) 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 -- 172.21.15.94:0/1592554820 learned_addr learned my addr 172.21.15.94:0/1592554820 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ded5700 1 --2- 172.21.15.94:0/1592554820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880bac50 0x7fde8814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 -- 172.21.15.94:0/1592554820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880bac50 msgr2=0x7fde8814a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 --2- 172.21.15.94:0/1592554820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880bac50 0x7fde8814a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 -- 172.21.15.94:0/1592554820 >> v1:172.21.15.151:6789/0 conn(0x7fde8809e4e0 legacy=0x7fde881404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 -- 172.21.15.94:0/1592554820 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880bb4c0 con 0x7fde880999d0 2024-03-18T18:25:40.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8ced3700 1 --2- 172.21.15.94:0/1592554820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880999d0 0x7fde88149ca0 secure :-1 s=READY pgs=4517 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfc36da5afa5d21 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde7ffff700 1 -- 172.21.15.94:0/1592554820 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011830 con 0x7fde880999d0 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde7ffff700 1 -- 172.21.15.94:0/1592554820 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84011990 con 0x7fde880999d0 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde7ffff700 1 -- 172.21.15.94:0/1592554820 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011d40 con 0x7fde880999d0 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- 172.21.15.94:0/1592554820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880999d0 msgr2=0x7fde88149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 --2- 172.21.15.94:0/1592554820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880999d0 0x7fde88149ca0 secure :-1 s=READY pgs=4517 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84009c20 comp rx=0 tx=0).stop 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- 172.21.15.94:0/1592554820 shutdown_connections 2024-03-18T18:25:40.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 --2- 172.21.15.94:0/1592554820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880bac50 0x7fde8814a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 --2- 172.21.15.94:0/1592554820 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde880999d0 0x7fde88149ca0 unknown :-1 s=CLOSED pgs=4517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- 172.21.15.94:0/1592554820 >> 172.21.15.94:0/1592554820 conn(0x7fde88073600 msgr2=0x7fde8809db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- 172.21.15.94:0/1592554820 shutdown_connections 2024-03-18T18:25:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- 172.21.15.94:0/1592554820 wait complete. 2024-03-18T18:25:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 Processor -- start 2024-03-18T18:25:40.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.315+0000 7fde8e6d6700 1 -- start start 2024-03-18T18:25:40.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880999d0 0x7fde8813f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde8809e4e0 0x7fde88147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde880bac50 0x7fde88138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8813ff80 con 0x7fde8809e4e0 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde881df7d0 con 0x7fde880bac50 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde881df4a0 con 0x7fde880999d0 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde8809e4e0 0x7fde88147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde8809e4e0 0x7fde88147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54908/0 (socket says 172.21.15.94:54908) 2024-03-18T18:25:40.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 -- 172.21.15.94:0/646131960 learned_addr learned my addr 172.21.15.94:0/646131960 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ded5700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde880bac50 0x7fde88138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8d6d4700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880999d0 0x7fde8813f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 -- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880999d0 msgr2=0x7fde8813f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde880999d0 0x7fde8813f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 -- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde880bac50 msgr2=0x7fde88138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde880bac50 0x7fde88138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 -- 172.21.15.94:0/646131960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009570 con 0x7fde8809e4e0 2024-03-18T18:25:40.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8ced3700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde8809e4e0 0x7fde88147630 secure :-1 s=READY pgs=4518 cs=0 l=1 rev1=1 crypto rx=0x7fde84000c00 tx=0x7fde84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84004510 con 0x7fde8809e4e0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde840036c0 con 0x7fde8809e4e0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde881dfc60 con 0x7fde8809e4e0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84003a70 con 0x7fde8809e4e0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde881453e0 con 0x7fde8809e4e0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.319+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde88150df0 con 0x7fde8809e4e0 2024-03-18T18:25:40.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fde84003bd0 con 0x7fde8809e4e0 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde7dffb700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde6c066730 0x7fde6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fde84021030 con 0x7fde8809e4e0 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde8d6d4700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde6c066730 0x7fde6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde7dffb700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7fde6c06eab0 0x7fde6c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 --> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde6c071620 con 0x7fde6c06eab0 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde84085fd0 con 0x7fde8809e4e0 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde8ded5700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7fde6c06eab0 0x7fde6c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde8d6d4700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde6c066730 0x7fde6c068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde78000f60 tx=0x7fde78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.323+0000 7fde8ded5700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7fde6c06eab0 0x7fde6c070f50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.327+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== osd.6 v2:172.21.15.151:6816/26216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fde6c071620 con 0x7fde6c06eab0 2024-03-18T18:25:40.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 --> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde881df2d0 con 0x7fde6c06eab0 2024-03-18T18:25:40.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde7dffb700 1 -- 172.21.15.94:0/646131960 <== osd.6 v2:172.21.15.151:6816/26216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fde881df2d0 con 0x7fde6c06eab0 2024-03-18T18:25:40.346 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:40.346 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:40.346 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:40.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7fde6c06eab0 msgr2=0x7fde6c070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.151:6816/26216,v1:172.21.15.151:6817/26216] conn(0x7fde6c06eab0 0x7fde6c070f50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde6c066730 msgr2=0x7fde6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde6c066730 0x7fde6c068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde78000f60 tx=0x7fde78009040 comp rx=0 tx=0).stop 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde8809e4e0 msgr2=0x7fde88147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 --2- 172.21.15.94:0/646131960 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde8809e4e0 0x7fde88147630 secure :-1 s=READY pgs=4518 cs=0 l=1 rev1=1 crypto rx=0x7fde84000c00 tx=0x7fde84004770 comp rx=0 tx=0).stop 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8ded5700 1 -- 172.21.15.94:0/646131960 reap_dead start 2024-03-18T18:25:40.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 shutdown_connections 2024-03-18T18:25:40.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 >> 172.21.15.94:0/646131960 conn(0x7fde88073600 msgr2=0x7fde880b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 shutdown_connections 2024-03-18T18:25:40.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.343+0000 7fde8e6d6700 1 -- 172.21.15.94:0/646131960 wait complete. 2024-03-18T18:25:40.359 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-18T18:25:40.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.467+0000 7feeecde1700 1 Processor -- start 2024-03-18T18:25:40.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.467+0000 7feeecde1700 1 -- start start 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.467+0000 7feeecde1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8156280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.467+0000 7feeecde1700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80af710 con 0x7feee80b8480 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.467+0000 7feeecde1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80b8860 con 0x7feee80ae9f0 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.467+0000 7feeecde1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80b0fe0 con 0x7feee8144f40 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee77fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7feee80b8480 0x7feee80af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39856/0 (socket says 172.21.15.94:39856) 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee77fe700 1 -- 172.21.15.94:0/3768658723 learned_addr learned my addr 172.21.15.94:0/3768658723 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:40.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee7fff700 1 --2- 172.21.15.94:0/3768658723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee6ffd700 1 -- 172.21.15.94:0/3768658723 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22785970 0 0) 0x7feee80af710 con 0x7feee80b8480 2024-03-18T18:25:40.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee6ffd700 1 -- 172.21.15.94:0/3768658723 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed40035d0 con 0x7feee80b8480 2024-03-18T18:25:40.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee7fff700 1 -- 172.21.15.94:0/3768658723 >> v1:172.21.15.151:6789/0 conn(0x7feee80ae9f0 legacy=0x7feee8144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee7fff700 1 -- 172.21.15.94:0/3768658723 >> v1:172.21.15.94:6789/0 conn(0x7feee80b8480 legacy=0x7feee80af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee7fff700 1 -- 172.21.15.94:0/3768658723 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80b43e0 con 0x7feee8144f40 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee7fff700 1 --2- 172.21.15.94:0/3768658723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8156280 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7feee0009dc0 tx=0x7feee000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4806d39fd0451b15 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee6ffd700 1 -- 172.21.15.94:0/3768658723 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000e070 con 0x7feee8144f40 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee6ffd700 1 -- 172.21.15.94:0/3768658723 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee000bb20 con 0x7feee8144f40 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feee6ffd700 1 -- 172.21.15.94:0/3768658723 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0012430 con 0x7feee8144f40 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 -- 172.21.15.94:0/3768658723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 msgr2=0x7feee8156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 --2- 172.21.15.94:0/3768658723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8156280 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7feee0009dc0 tx=0x7feee000b330 comp rx=0 tx=0).stop 2024-03-18T18:25:40.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 -- 172.21.15.94:0/3768658723 shutdown_connections 2024-03-18T18:25:40.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 --2- 172.21.15.94:0/3768658723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8156280 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 -- 172.21.15.94:0/3768658723 >> 172.21.15.94:0/3768658723 conn(0x7feee806a780 msgr2=0x7feee80b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 -- 172.21.15.94:0/3768658723 shutdown_connections 2024-03-18T18:25:40.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.471+0000 7feeecde1700 1 -- 172.21.15.94:0/3768658723 wait complete. 2024-03-18T18:25:40.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 Processor -- start 2024-03-18T18:25:40.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 -- start start 2024-03-18T18:25:40.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 0x7feee8145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee80b8480 0x7feee8070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8147f90 con 0x7feee80ae9f0 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8145ec0 con 0x7feee80b8480 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee8146160 con 0x7feee8144f40 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 0x7feee8145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 0x7feee8145830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54918/0 (socket says 172.21.15.94:54918) 2024-03-18T18:25:40.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 -- 172.21.15.94:0/743674073 learned_addr learned my addr 172.21.15.94:0/743674073 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:40.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee7fff700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feedeffd700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee80b8480 0x7feee8070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 -- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 msgr2=0x7feee8071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 -- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee80b8480 msgr2=0x7feee8070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee80b8480 0x7feee8070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 -- 172.21.15.94:0/743674073 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0009a70 con 0x7feee80ae9f0 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee77fe700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 0x7feee8145830 secure :-1 s=READY pgs=4520 cs=0 l=1 rev1=1 crypto rx=0x7feed800c700 tx=0x7feed800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8005d90 con 0x7feee80ae9f0 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed80070d0 con 0x7feee80ae9f0 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8147360 con 0x7feee80ae9f0 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8007480 con 0x7feee80ae9f0 2024-03-18T18:25:40.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.475+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee8146ed0 con 0x7feee80ae9f0 2024-03-18T18:25:40.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.479+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee8146370 con 0x7feee80ae9f0 2024-03-18T18:25:40.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.479+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7feed80075e0 con 0x7feee80ae9f0 2024-03-18T18:25:40.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.479+0000 7feee4ff9700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7feec8066730 0x7feec8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.479+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7feed80836d0 con 0x7feee80ae9f0 2024-03-18T18:25:40.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.479+0000 7feedeffd700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7feec8066730 0x7feec8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.479+0000 7feedeffd700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7feec8066730 0x7feec8068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feee81dd4f0 tx=0x7feed0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.487+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feed8050930 con 0x7feee80ae9f0 2024-03-18T18:25:40.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.655+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7feee81474f0 con 0x7feec8066730 2024-03-18T18:25:40.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.655+0000 7feee4ff9700 1 -- 172.21.15.94:0/743674073 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feee81474f0 con 0x7feec8066730 2024-03-18T18:25:40.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7feec8066730 msgr2=0x7feec8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7feec8066730 0x7feec8068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feee81dd4f0 tx=0x7feed0009040 comp rx=0 tx=0).stop 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 msgr2=0x7feee8145830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 0x7feee8145830 secure :-1 s=READY pgs=4520 cs=0 l=1 rev1=1 crypto rx=0x7feed800c700 tx=0x7feed800ca10 comp rx=0 tx=0).stop 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 shutdown_connections 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7feec8066730 0x7feec8068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee8144f40 0x7feee8071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee80b8480 0x7feee8070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 --2- 172.21.15.94:0/743674073 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee80ae9f0 0x7feee8145830 unknown :-1 s=CLOSED pgs=4520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 >> 172.21.15.94:0/743674073 conn(0x7feee806a780 msgr2=0x7feee8148940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 shutdown_connections 2024-03-18T18:25:40.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.659+0000 7feeecde1700 1 -- 172.21.15.94:0/743674073 wait complete. 2024-03-18T18:25:40.663 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-03-18T18:25:40.674 INFO:tasks.ceph:Scrubbing osd.7 2024-03-18T18:25:40.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-18T18:25:40.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.787+0000 7f8c15097700 1 Processor -- start 2024-03-18T18:25:40.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.787+0000 7f8c15097700 1 -- start start 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8c10071d90 0x7f8c100b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8c101432b0 0x7f8c10143740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c10072170 con 0x7f8c10146820 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c100b1600 con 0x7f8c101432b0 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1013da50 con 0x7f8c10071d90 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c14896700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8c10146820 0x7f8c10146c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39870/0 (socket says 172.21.15.94:39870) 2024-03-18T18:25:40.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c14896700 1 -- 172.21.15.94:0/2455776665 learned_addr learned my addr 172.21.15.94:0/2455776665 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0f7fe700 1 --2- 172.21.15.94:0/2455776665 >> v2:172.21.15.94:3300/0 conn(0x7f8c101432b0 0x7f8c10143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0ffff700 1 --2- 172.21.15.94:0/2455776665 >> v2:172.21.15.151:3300/0 conn(0x7f8c10071d90 0x7f8c100b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0f7fe700 1 -- 172.21.15.94:0/2455776665 >> v2:172.21.15.151:3300/0 conn(0x7f8c10071d90 msgr2=0x7f8c100b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0f7fe700 1 --2- 172.21.15.94:0/2455776665 >> v2:172.21.15.151:3300/0 conn(0x7f8c10071d90 0x7f8c100b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0f7fe700 1 -- 172.21.15.94:0/2455776665 >> v1:172.21.15.94:6789/0 conn(0x7f8c10146820 legacy=0x7f8c10146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0f7fe700 1 -- 172.21.15.94:0/2455776665 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100b1a90 con 0x7f8c101432b0 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0f7fe700 1 --2- 172.21.15.94:0/2455776665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c101432b0 0x7f8c10143740 secure :-1 s=READY pgs=4522 cs=0 l=1 rev1=1 crypto rx=0x7f8c100b5670 tx=0x7f8c0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca658edc79998f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0effd700 1 -- 172.21.15.94:0/2455776665 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000e070 con 0x7f8c101432b0 2024-03-18T18:25:40.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0effd700 1 -- 172.21.15.94:0/2455776665 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000bbd0 con 0x7f8c101432b0 2024-03-18T18:25:40.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c0effd700 1 -- 172.21.15.94:0/2455776665 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00012430 con 0x7f8c101432b0 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- 172.21.15.94:0/2455776665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c101432b0 msgr2=0x7f8c10143740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 --2- 172.21.15.94:0/2455776665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c101432b0 0x7f8c10143740 secure :-1 s=READY pgs=4522 cs=0 l=1 rev1=1 crypto rx=0x7f8c100b5670 tx=0x7f8c0000b330 comp rx=0 tx=0).stop 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- 172.21.15.94:0/2455776665 shutdown_connections 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 --2- 172.21.15.94:0/2455776665 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c101432b0 0x7f8c10143740 unknown :-1 s=CLOSED pgs=4522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 --2- 172.21.15.94:0/2455776665 >> v2:172.21.15.151:3300/0 conn(0x7f8c10071d90 0x7f8c100b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- 172.21.15.94:0/2455776665 >> 172.21.15.94:0/2455776665 conn(0x7f8c1006a780 msgr2=0x7f8c100b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- 172.21.15.94:0/2455776665 shutdown_connections 2024-03-18T18:25:40.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.791+0000 7f8c15097700 1 -- 172.21.15.94:0/2455776665 wait complete. 2024-03-18T18:25:40.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 Processor -- start 2024-03-18T18:25:40.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 -- start start 2024-03-18T18:25:40.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c10071d90 0x7f8c10070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c101432b0 0x7f8c1013dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c10146820 0x7f8c101db590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1013e470 con 0x7f8c10071d90 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100b7970 con 0x7f8c101432b0 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c15097700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100b7e00 con 0x7f8c10146820 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c0ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c10071d90 0x7f8c10070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c0ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c10071d90 0x7f8c10070830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54944/0 (socket says 172.21.15.94:54944) 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c0ffff700 1 -- 172.21.15.94:0/1851752269 learned_addr learned my addr 172.21.15.94:0/1851752269 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c0f7fe700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c101432b0 0x7f8c1013dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.795+0000 7f8c14896700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c10146820 0x7f8c101db590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0ffff700 1 -- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c10146820 msgr2=0x7f8c101db590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0ffff700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c10146820 0x7f8c101db590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0ffff700 1 -- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c101432b0 msgr2=0x7f8c1013dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0ffff700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c101432b0 0x7f8c1013dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0ffff700 1 -- 172.21.15.94:0/1851752269 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009a70 con 0x7f8c10071d90 2024-03-18T18:25:40.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0ffff700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c10071d90 0x7f8c10070830 secure :-1 s=READY pgs=4523 cs=0 l=1 rev1=1 crypto rx=0x7f8c04010750 tx=0x7f8c04010a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04011920 con 0x7f8c10071d90 2024-03-18T18:25:40.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04011a80 con 0x7f8c10071d90 2024-03-18T18:25:40.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1013e1d0 con 0x7f8c10071d90 2024-03-18T18:25:40.803 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04011df0 con 0x7f8c10071d90 2024-03-18T18:25:40.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c100b7600 con 0x7f8c10071d90 2024-03-18T18:25:40.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c100b0b30 con 0x7f8c10071d90 2024-03-18T18:25:40.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8c04019440 con 0x7f8c10071d90 2024-03-18T18:25:40.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.799+0000 7f8c0cff9700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8bfc066730 0x7f8bfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0f7fe700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8bfc066730 0x7f8bfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8c040866f0 con 0x7f8c10071d90 2024-03-18T18:25:40.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0cff9700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f8bfc06eab0 0x7f8bfc070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 --> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bfc071620 con 0x7f8bfc06eab0 2024-03-18T18:25:40.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c04086a60 con 0x7f8c10071d90 2024-03-18T18:25:40.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c14896700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f8bfc06eab0 0x7f8bfc070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0f7fe700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8bfc066730 0x7f8bfc068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c00014040 tx=0x7f8c00011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c14896700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f8bfc06eab0 0x7f8bfc070f50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.806 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.803+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== osd.7 v2:172.21.15.151:6800/26214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8bfc071620 con 0x7f8bfc06eab0 2024-03-18T18:25:40.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.819+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 --> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c100b7ab0 con 0x7f8bfc06eab0 2024-03-18T18:25:40.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c0cff9700 1 -- 172.21.15.94:0/1851752269 <== osd.7 v2:172.21.15.151:6800/26214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8c080014a0 con 0x7f8bfc06eab0 2024-03-18T18:25:40.824 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-03-18T18:25:40.824 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T18:25:40.825 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f8bfc06eab0 msgr2=0x7f8bfc070f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.151:6800/26214,v1:172.21.15.151:6801/26214] conn(0x7f8bfc06eab0 0x7f8bfc070f50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8bfc066730 msgr2=0x7f8bfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f8bfc066730 0x7f8bfc068bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8c00014040 tx=0x7f8c00011000 comp rx=0 tx=0).stop 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c10071d90 msgr2=0x7f8c10070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 --2- 172.21.15.94:0/1851752269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8c10071d90 0x7f8c10070830 secure :-1 s=READY pgs=4523 cs=0 l=1 rev1=1 crypto rx=0x7f8c04010750 tx=0x7f8c04010a60 comp rx=0 tx=0).stop 2024-03-18T18:25:40.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c14896700 1 -- 172.21.15.94:0/1851752269 reap_dead start 2024-03-18T18:25:40.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 shutdown_connections 2024-03-18T18:25:40.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 >> 172.21.15.94:0/1851752269 conn(0x7f8c1006a780 msgr2=0x7f8c1013ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 shutdown_connections 2024-03-18T18:25:40.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.823+0000 7f8c15097700 1 -- 172.21.15.94:0/1851752269 wait complete. 2024-03-18T18:25:40.837 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-18T18:25:40.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 Processor -- start 2024-03-18T18:25:40.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 -- start start 2024-03-18T18:25:40.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b413dff0 0x7f70b413e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70b414cbb0 0x7f70b414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b4073680 con 0x7f70b40732a0 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b41487e0 con 0x7f70b414cbb0 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70ba657700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b4072a00 con 0x7f70b413dff0 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b9655700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f70b40732a0 0x7f70b41480d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:39878/0 (socket says 172.21.15.94:39878) 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b9655700 1 -- 172.21.15.94:0/2128673339 learned_addr learned my addr 172.21.15.94:0/2128673339 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b8e54700 1 --2- 172.21.15.94:0/2128673339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b413dff0 0x7f70b413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b9e56700 1 --2- 172.21.15.94:0/2128673339 >> v2:172.21.15.151:3300/0 conn(0x7f70b414cbb0 0x7f70b414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70a7fff700 1 -- 172.21.15.94:0/2128673339 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229608408 0 0) 0x7f70b4073680 con 0x7f70b40732a0 2024-03-18T18:25:40.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70a7fff700 1 -- 172.21.15.94:0/2128673339 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a00035d0 con 0x7f70b40732a0 2024-03-18T18:25:40.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b8e54700 1 -- 172.21.15.94:0/2128673339 >> v2:172.21.15.151:3300/0 conn(0x7f70b414cbb0 msgr2=0x7f70b414efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:40.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70a7fff700 1 -- 172.21.15.94:0/2128673339 <== mon.0 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734834936 0 0) 0x7f70a00035d0 con 0x7f70b40732a0 2024-03-18T18:25:40.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b8e54700 1 --2- 172.21.15.94:0/2128673339 >> v2:172.21.15.151:3300/0 conn(0x7f70b414cbb0 0x7f70b414efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b8e54700 1 -- 172.21.15.94:0/2128673339 >> v1:172.21.15.94:6789/0 conn(0x7f70b40732a0 legacy=0x7f70b41480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b8e54700 1 -- 172.21.15.94:0/2128673339 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4070490 con 0x7f70b413dff0 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b9e56700 1 --2- 172.21.15.94:0/2128673339 >> v2:172.21.15.151:3300/0 conn(0x7f70b414cbb0 0x7f70b414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70b8e54700 1 --2- 172.21.15.94:0/2128673339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b413dff0 0x7f70b413e450 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009880 tx=0x7f70a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=644f8a46b2c1bb04 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70a7fff700 1 -- 172.21.15.94:0/2128673339 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0001670 con 0x7f70b413dff0 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70a7fff700 1 -- 172.21.15.94:0/2128673339 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8004030 con 0x7f70b413dff0 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.951+0000 7f70a7fff700 1 -- 172.21.15.94:0/2128673339 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80043c0 con 0x7f70b413dff0 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- 172.21.15.94:0/2128673339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b413dff0 msgr2=0x7f70b413e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 --2- 172.21.15.94:0/2128673339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b413dff0 0x7f70b413e450 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009880 tx=0x7f70a8009b90 comp rx=0 tx=0).stop 2024-03-18T18:25:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- 172.21.15.94:0/2128673339 shutdown_connections 2024-03-18T18:25:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 --2- 172.21.15.94:0/2128673339 >> v2:172.21.15.151:3300/0 conn(0x7f70b414cbb0 0x7f70b414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 --2- 172.21.15.94:0/2128673339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b413dff0 0x7f70b413e450 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- 172.21.15.94:0/2128673339 >> 172.21.15.94:0/2128673339 conn(0x7f70b40b4c70 msgr2=0x7f70b40b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- 172.21.15.94:0/2128673339 shutdown_connections 2024-03-18T18:25:40.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- 172.21.15.94:0/2128673339 wait complete. 2024-03-18T18:25:40.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 Processor -- start 2024-03-18T18:25:40.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- start start 2024-03-18T18:25:40.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 0x7f70b4136670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b413dff0 0x7f70b41d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b414cbb0 0x7f70b4142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b413f8f0 con 0x7f70b40732a0 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b413c150 con 0x7f70b413dff0 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70ba657700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b4142110 con 0x7f70b414cbb0 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70b9655700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 0x7f70b4136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70b9655700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 0x7f70b4136670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54954/0 (socket says 172.21.15.94:54954) 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70b9655700 1 -- 172.21.15.94:0/1780247542 learned_addr learned my addr 172.21.15.94:0/1780247542 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:40.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70b9655700 1 -- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b414cbb0 msgr2=0x7f70b4142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70b8e54700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b413dff0 0x7f70b41d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.955+0000 7f70b9655700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b414cbb0 0x7f70b4142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70b9655700 1 -- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b413dff0 msgr2=0x7f70b41d9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70b9655700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b413dff0 0x7f70b41d9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70b9655700 1 -- 172.21.15.94:0/1780247542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009a70 con 0x7f70b40732a0 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70b8e54700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b413dff0 0x7f70b41d9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70b9655700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 0x7f70b4136670 secure :-1 s=READY pgs=4525 cs=0 l=1 rev1=1 crypto rx=0x7f70b000c730 tx=0x7f70b000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0004ca0 con 0x7f70b40732a0 2024-03-18T18:25:40.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0004e00 con 0x7f70b40732a0 2024-03-18T18:25:40.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a80094b0 con 0x7f70b40732a0 2024-03-18T18:25:40.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0007310 con 0x7f70b40732a0 2024-03-18T18:25:40.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b41417a0 con 0x7f70b40732a0 2024-03-18T18:25:40.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b4074440 con 0x7f70b40732a0 2024-03-18T18:25:40.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f70b0007470 con 0x7f70b40732a0 2024-03-18T18:25:40.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70a5ffb700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7098066760 0x7f7098068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:40.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70b8e54700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7098066760 0x7f7098068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:40.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.959+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f70b0083660 con 0x7f70b40732a0 2024-03-18T18:25:40.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.963+0000 7f70b8e54700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7098066760 0x7f7098068c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70b41374a0 tx=0x7f70a8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:40.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:40.967+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f70b00509d0 con 0x7f70b40732a0 2024-03-18T18:25:41.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.143+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f70b40b22f0 con 0x7f7098066760 2024-03-18T18:25:41.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.143+0000 7f70a5ffb700 1 -- 172.21.15.94:0/1780247542 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70a8021090 con 0x7f7098066760 2024-03-18T18:25:41.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7098066760 msgr2=0x7f7098068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7098066760 0x7f7098068c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f70b41374a0 tx=0x7f70a8010000 comp rx=0 tx=0).stop 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 msgr2=0x7f70b4136670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 0x7f70b4136670 secure :-1 s=READY pgs=4525 cs=0 l=1 rev1=1 crypto rx=0x7f70b000c730 tx=0x7f70b000caf0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 shutdown_connections 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f7098066760 0x7f7098068c20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b414cbb0 0x7f70b4142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b413dff0 0x7f70b41d9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 --2- 172.21.15.94:0/1780247542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b40732a0 0x7f70b4136670 unknown :-1 s=CLOSED pgs=4525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 >> 172.21.15.94:0/1780247542 conn(0x7f70b40b4c70 msgr2=0x7f70b40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:41.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 shutdown_connections 2024-03-18T18:25:41.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.147+0000 7f70ba657700 1 -- 172.21.15.94:0/1780247542 wait complete. 2024-03-18T18:25:41.151 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-03-18T18:25:41.165 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:25:41.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 Processor -- start 2024-03-18T18:25:41.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- start start 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac5c14e0a0 0x7fac5c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac5c0b1000 0x7fac5c14e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0af790 con 0x7fac5c14e9c0 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c0af210 con 0x7fac5c0b1000 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c06e700 con 0x7fac5c14e0a0 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac5c0b1000 0x7fac5c14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:41.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fac5c0b1000 0x7fac5c14e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54958/0 (socket says 172.21.15.94:54958) 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 -- 172.21.15.94:0/2752813330 learned_addr learned my addr 172.21.15.94:0/2752813330 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5b7fe700 1 --2- 172.21.15.94:0/2752813330 >> v2:172.21.15.151:3300/0 conn(0x7fac5c14e0a0 0x7fac5c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 -- 172.21.15.94:0/2752813330 >> v2:172.21.15.151:3300/0 conn(0x7fac5c14e0a0 msgr2=0x7fac5c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 --2- 172.21.15.94:0/2752813330 >> v2:172.21.15.151:3300/0 conn(0x7fac5c14e0a0 0x7fac5c0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 -- 172.21.15.94:0/2752813330 >> v1:172.21.15.151:6789/0 conn(0x7fac5c14e9c0 legacy=0x7fac5c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 -- 172.21.15.94:0/2752813330 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0b0160 con 0x7fac5c0b1000 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5affd700 1 --2- 172.21.15.94:0/2752813330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c0b1000 0x7fac5c14e480 secure :-1 s=READY pgs=4526 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06cbe0 tx=0x7fac5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f29333ef74efd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:41.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5a7fc700 1 -- 172.21.15.94:0/2752813330 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400e070 con 0x7fac5c0b1000 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5a7fc700 1 -- 172.21.15.94:0/2752813330 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54003a40 con 0x7fac5c0b1000 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac5a7fc700 1 -- 172.21.15.94:0/2752813330 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54003df0 con 0x7fac5c0b1000 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- 172.21.15.94:0/2752813330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c0b1000 msgr2=0x7fac5c14e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 --2- 172.21.15.94:0/2752813330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c0b1000 0x7fac5c14e480 secure :-1 s=READY pgs=4526 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06cbe0 tx=0x7fac5400b330 comp rx=0 tx=0).stop 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- 172.21.15.94:0/2752813330 shutdown_connections 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 --2- 172.21.15.94:0/2752813330 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c0b1000 0x7fac5c14e480 unknown :-1 s=CLOSED pgs=4526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 --2- 172.21.15.94:0/2752813330 >> v2:172.21.15.151:3300/0 conn(0x7fac5c14e0a0 0x7fac5c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- 172.21.15.94:0/2752813330 >> 172.21.15.94:0/2752813330 conn(0x7fac5c0b7a20 msgr2=0x7fac5c0b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:41.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- 172.21.15.94:0/2752813330 shutdown_connections 2024-03-18T18:25:41.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.283+0000 7fac60d17700 1 -- 172.21.15.94:0/2752813330 wait complete. 2024-03-18T18:25:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 Processor -- start 2024-03-18T18:25:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- start start 2024-03-18T18:25:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c14e0a0 0x7fac5c1df860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 0x7fac5c14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c1478e0 0x7fac5c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:41.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c145f30 con 0x7fac5c14e9c0 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c1451f0 con 0x7fac5c14e0a0 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c1454d0 con 0x7fac5c1478e0 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 0x7fac5c14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 0x7fac5c14b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54966/0 (socket says 172.21.15.94:54966) 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 -- 172.21.15.94:0/2872697144 learned_addr learned my addr 172.21.15.94:0/2872697144 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 -- 172.21.15.94:0/2872697144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c1478e0 msgr2=0x7fac5c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c1478e0 0x7fac5c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 -- 172.21.15.94:0/2872697144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c14e0a0 msgr2=0x7fac5c1df860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c14e0a0 0x7fac5c1df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 -- 172.21.15.94:0/2872697144 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac54009b30 con 0x7fac5c14e9c0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac5affd700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 0x7fac5c14b170 secure :-1 s=READY pgs=4527 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06ce40 tx=0x7fac54004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54004500 con 0x7fac5c14e9c0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54004660 con 0x7fac5c14e9c0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c146c00 con 0x7fac5c14e9c0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54012430 con 0x7fac5c14e9c0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c147d60 con 0x7fac5c14e9c0 2024-03-18T18:25:41.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.287+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c0b4320 con 0x7fac5c14e9c0 2024-03-18T18:25:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.291+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fac54012590 con 0x7fac5c14e9c0 2024-03-18T18:25:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.291+0000 7fac53fff700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fac3c066730 0x7fac3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:25:41.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.291+0000 7fac5b7fe700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fac3c066730 0x7fac3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:25:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.291+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fac54085b50 con 0x7fac5c14e9c0 2024-03-18T18:25:41.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.291+0000 7fac5b7fe700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fac3c066730 0x7fac3c068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac4400a8d0 tx=0x7fac44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:25:41.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.299+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fac54052e20 con 0x7fac5c14e9c0 2024-03-18T18:25:41.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.463+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac5c0b2420 con 0x7fac3c066730 2024-03-18T18:25:41.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.479+0000 7fac53fff700 1 -- 172.21.15.94:0/2872697144 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289184 (secure 0 0 0) 0x7fac4400a570 con 0x7fac3c066730 2024-03-18T18:25:41.484 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:25:41.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fac3c066730 msgr2=0x7fac3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fac3c066730 0x7fac3c068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac4400a8d0 tx=0x7fac44008040 comp rx=0 tx=0).stop 2024-03-18T18:25:41.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 msgr2=0x7fac5c14b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:25:41.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 0x7fac5c14b170 secure :-1 s=READY pgs=4527 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06ce40 tx=0x7fac54004af0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 shutdown_connections 2024-03-18T18:25:41.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fac3c066730 0x7fac3c068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c1478e0 0x7fac5c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac5c14e9c0 0x7fac5c14b170 unknown :-1 s=CLOSED pgs=4527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 --2- 172.21.15.94:0/2872697144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c14e0a0 0x7fac5c1df860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:25:41.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 >> 172.21.15.94:0/2872697144 conn(0x7fac5c0b7a20 msgr2=0x7fac5c0b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:25:41.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 shutdown_connections 2024-03-18T18:25:41.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:25:41.483+0000 7fac60d17700 1 -- 172.21.15.94:0/2872697144 wait complete. 2024-03-18T18:25:41.489 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:25:41.500 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":550,"stamp":"2024-03-18T18:25:40.916114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265707618,"num_objects":228,"num_object_clones":28,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":15,"num_read":1722,"num_read_kb":4075,"num_write":163797,"num_write_kb":738450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327149,"ondisk_log_size":327149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2963196,"kb_used_data":524128,"kb_used_omap":12,"kb_used_meta":2438963,"kb_avail":752011524,"statfs":{"total":773094113280,"available":770059800576,"internally_reserved":0,"allocated":536707072,"data_stored":533742460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2497498684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":831323,"num_objects":1,"num_object_clones":1,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":3,"num_read":4,"num_read_kb":5,"num_write":44,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.173963"},"pg_stats":[{"pgid":"3.3f","version":"54'3532","reported_seq":2942,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751981+0000","last_change":"2024-03-18T18:25:29.057112+0000","last_active":"2024-03-18T18:25:37.751981+0000","last_peered":"2024-03-18T18:25:37.751981+0000","last_clean":"2024-03-18T18:25:37.751981+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:25:37.751981+0000","last_undegraded":"2024-03-18T18:25:37.751981+0000","last_fullsized":"2024-03-18T18:25:37.751981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:19.379150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"54'3322","reported_seq":2750,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821677+0000","last_change":"2024-03-18T18:25:29.045338+0000","last_active":"2024-03-18T18:25:37.821677+0000","last_peered":"2024-03-18T18:25:37.821677+0000","last_clean":"2024-03-18T18:25:37.821677+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:25:37.821677+0000","last_undegraded":"2024-03-18T18:25:37.821677+0000","last_fullsized":"2024-03-18T18:25:37.821677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"54'3570","reported_seq":2981,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.822348+0000","last_change":"2024-03-18T18:25:29.051316+0000","last_active":"2024-03-18T18:25:37.822348+0000","last_peered":"2024-03-18T18:25:37.822348+0000","last_clean":"2024-03-18T18:25:37.822348+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:37.822348+0000","last_undegraded":"2024-03-18T18:25:37.822348+0000","last_fullsized":"2024-03-18T18:25:37.822348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"54'3829","reported_seq":3141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820459+0000","last_change":"2024-03-18T18:25:29.029488+0000","last_active":"2024-03-18T18:25:37.820459+0000","last_peered":"2024-03-18T18:25:37.820459+0000","last_clean":"2024-03-18T18:25:37.820459+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:25:37.820459+0000","last_undegraded":"2024-03-18T18:25:37.820459+0000","last_fullsized":"2024-03-18T18:25:37.820459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"54'3564","reported_seq":2930,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751007+0000","last_change":"2024-03-18T18:25:29.053880+0000","last_active":"2024-03-18T18:25:37.751007+0000","last_peered":"2024-03-18T18:25:37.751007+0000","last_clean":"2024-03-18T18:25:37.751007+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:25:37.751007+0000","last_undegraded":"2024-03-18T18:25:37.751007+0000","last_fullsized":"2024-03-18T18:25:37.751007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"54'3681","reported_seq":3012,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752347+0000","last_change":"2024-03-18T18:25:29.226526+0000","last_active":"2024-03-18T18:25:37.752347+0000","last_peered":"2024-03-18T18:25:37.752347+0000","last_clean":"2024-03-18T18:25:37.752347+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:25:37.752347+0000","last_undegraded":"2024-03-18T18:25:37.752347+0000","last_fullsized":"2024-03-18T18:25:37.752347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"54'3919","reported_seq":3244,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750522+0000","last_change":"2024-03-18T18:25:29.050955+0000","last_active":"2024-03-18T18:25:37.750522+0000","last_peered":"2024-03-18T18:25:37.750522+0000","last_clean":"2024-03-18T18:25:37.750522+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:25:37.750522+0000","last_undegraded":"2024-03-18T18:25:37.750522+0000","last_fullsized":"2024-03-18T18:25:37.750522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:29.514283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"54'3528","reported_seq":2941,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752081+0000","last_change":"2024-03-18T18:25:29.224146+0000","last_active":"2024-03-18T18:25:37.752081+0000","last_peered":"2024-03-18T18:25:37.752081+0000","last_clean":"2024-03-18T18:25:37.752081+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:25:37.752081+0000","last_undegraded":"2024-03-18T18:25:37.752081+0000","last_fullsized":"2024-03-18T18:25:37.752081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"54'3888","reported_seq":3248,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752368+0000","last_change":"2024-03-18T18:25:29.056418+0000","last_active":"2024-03-18T18:25:37.752368+0000","last_peered":"2024-03-18T18:25:37.752368+0000","last_clean":"2024-03-18T18:25:37.752368+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:25:37.752368+0000","last_undegraded":"2024-03-18T18:25:37.752368+0000","last_fullsized":"2024-03-18T18:25:37.752368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:36:44.035857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"54'3828","reported_seq":3246,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.757116+0000","last_change":"2024-03-18T18:25:29.022953+0000","last_active":"2024-03-18T18:25:37.757116+0000","last_peered":"2024-03-18T18:25:37.757116+0000","last_clean":"2024-03-18T18:25:37.757116+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:25:37.757116+0000","last_undegraded":"2024-03-18T18:25:37.757116+0000","last_fullsized":"2024-03-18T18:25:37.757116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:01.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"54'3542","reported_seq":2968,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756486+0000","last_change":"2024-03-18T18:25:29.017560+0000","last_active":"2024-03-18T18:25:37.756486+0000","last_peered":"2024-03-18T18:25:37.756486+0000","last_clean":"2024-03-18T18:25:37.756486+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:25:37.756486+0000","last_undegraded":"2024-03-18T18:25:37.756486+0000","last_fullsized":"2024-03-18T18:25:37.756486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"54'4127","reported_seq":3423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820572+0000","last_change":"2024-03-18T18:25:29.195788+0000","last_active":"2024-03-18T18:25:37.820572+0000","last_peered":"2024-03-18T18:25:37.820572+0000","last_clean":"2024-03-18T18:25:37.820572+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:37.820572+0000","last_undegraded":"2024-03-18T18:25:37.820572+0000","last_fullsized":"2024-03-18T18:25:37.820572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"54'3608","reported_seq":3016,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748122+0000","last_change":"2024-03-18T18:25:29.043841+0000","last_active":"2024-03-18T18:25:37.748122+0000","last_peered":"2024-03-18T18:25:37.748122+0000","last_clean":"2024-03-18T18:25:37.748122+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:25:37.748122+0000","last_undegraded":"2024-03-18T18:25:37.748122+0000","last_fullsized":"2024-03-18T18:25:37.748122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:42:12.087942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"54'3871","reported_seq":3173,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819104+0000","last_change":"2024-03-18T18:25:29.047066+0000","last_active":"2024-03-18T18:25:37.819104+0000","last_peered":"2024-03-18T18:25:37.819104+0000","last_clean":"2024-03-18T18:25:37.819104+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:37.819104+0000","last_undegraded":"2024-03-18T18:25:37.819104+0000","last_fullsized":"2024-03-18T18:25:37.819104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"54'3829","reported_seq":3155,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820585+0000","last_change":"2024-03-18T18:25:29.032597+0000","last_active":"2024-03-18T18:25:37.820585+0000","last_peered":"2024-03-18T18:25:37.820585+0000","last_clean":"2024-03-18T18:25:37.820585+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:25:37.820585+0000","last_undegraded":"2024-03-18T18:25:37.820585+0000","last_fullsized":"2024-03-18T18:25:37.820585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"54'4022","reported_seq":3334,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818024+0000","last_change":"2024-03-18T18:25:29.024791+0000","last_active":"2024-03-18T18:25:37.818024+0000","last_peered":"2024-03-18T18:25:37.818024+0000","last_clean":"2024-03-18T18:25:37.818024+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:25:37.818024+0000","last_undegraded":"2024-03-18T18:25:37.818024+0000","last_fullsized":"2024-03-18T18:25:37.818024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"54'3796","reported_seq":3105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819379+0000","last_change":"2024-03-18T18:25:29.030461+0000","last_active":"2024-03-18T18:25:37.819379+0000","last_peered":"2024-03-18T18:25:37.819379+0000","last_clean":"2024-03-18T18:25:37.819379+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:25:37.819379+0000","last_undegraded":"2024-03-18T18:25:37.819379+0000","last_fullsized":"2024-03-18T18:25:37.819379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"54'3740","reported_seq":3144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752967+0000","last_change":"2024-03-18T18:25:29.221387+0000","last_active":"2024-03-18T18:25:37.752967+0000","last_peered":"2024-03-18T18:25:37.752967+0000","last_clean":"2024-03-18T18:25:37.752967+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:37.752967+0000","last_undegraded":"2024-03-18T18:25:37.752967+0000","last_fullsized":"2024-03-18T18:25:37.752967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"54'3972","reported_seq":3275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752162+0000","last_change":"2024-03-18T18:25:29.055765+0000","last_active":"2024-03-18T18:25:37.752162+0000","last_peered":"2024-03-18T18:25:37.752162+0000","last_clean":"2024-03-18T18:25:37.752162+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:25:37.752162+0000","last_undegraded":"2024-03-18T18:25:37.752162+0000","last_fullsized":"2024-03-18T18:25:37.752162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:01:27.090237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"54'3755","reported_seq":3116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756367+0000","last_change":"2024-03-18T18:25:29.019398+0000","last_active":"2024-03-18T18:25:37.756367+0000","last_peered":"2024-03-18T18:25:37.756367+0000","last_clean":"2024-03-18T18:25:37.756367+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:25:37.756367+0000","last_undegraded":"2024-03-18T18:25:37.756367+0000","last_fullsized":"2024-03-18T18:25:37.756367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:11:00.135540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"54'3495","reported_seq":2916,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818666+0000","last_change":"2024-03-18T18:25:29.059001+0000","last_active":"2024-03-18T18:25:37.818666+0000","last_peered":"2024-03-18T18:25:37.818666+0000","last_clean":"2024-03-18T18:25:37.818666+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:25:37.818666+0000","last_undegraded":"2024-03-18T18:25:37.818666+0000","last_fullsized":"2024-03-18T18:25:37.818666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"54'4356","reported_seq":3576,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820036+0000","last_change":"2024-03-18T18:25:29.035858+0000","last_active":"2024-03-18T18:25:37.820036+0000","last_peered":"2024-03-18T18:25:37.820036+0000","last_clean":"2024-03-18T18:25:37.820036+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:25:37.820036+0000","last_undegraded":"2024-03-18T18:25:37.820036+0000","last_fullsized":"2024-03-18T18:25:37.820036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4356,"log_dups_size":0,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"54'3901","reported_seq":3234,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748184+0000","last_change":"2024-03-18T18:25:29.040440+0000","last_active":"2024-03-18T18:25:37.748184+0000","last_peered":"2024-03-18T18:25:37.748184+0000","last_clean":"2024-03-18T18:25:37.748184+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:25:37.748184+0000","last_undegraded":"2024-03-18T18:25:37.748184+0000","last_fullsized":"2024-03-18T18:25:37.748184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:40.728877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"54'4190","reported_seq":3411,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818932+0000","last_change":"2024-03-18T18:25:29.027847+0000","last_active":"2024-03-18T18:25:37.818932+0000","last_peered":"2024-03-18T18:25:37.818932+0000","last_clean":"2024-03-18T18:25:37.818932+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:25:37.818932+0000","last_undegraded":"2024-03-18T18:25:37.818932+0000","last_fullsized":"2024-03-18T18:25:37.818932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"54'3282","reported_seq":2725,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749790+0000","last_change":"2024-03-18T18:25:29.043669+0000","last_active":"2024-03-18T18:25:37.749790+0000","last_peered":"2024-03-18T18:25:37.749790+0000","last_clean":"2024-03-18T18:25:37.749790+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:25:37.749790+0000","last_undegraded":"2024-03-18T18:25:37.749790+0000","last_fullsized":"2024-03-18T18:25:37.749790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:58:21.743832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"54'3785","reported_seq":3147,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.757222+0000","last_change":"2024-03-18T18:25:29.022945+0000","last_active":"2024-03-18T18:25:37.757222+0000","last_peered":"2024-03-18T18:25:37.757222+0000","last_clean":"2024-03-18T18:25:37.757222+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:25:37.757222+0000","last_undegraded":"2024-03-18T18:25:37.757222+0000","last_fullsized":"2024-03-18T18:25:37.757222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:33:28.060830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"54'3857","reported_seq":3176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821463+0000","last_change":"2024-03-18T18:25:29.046199+0000","last_active":"2024-03-18T18:25:37.821463+0000","last_peered":"2024-03-18T18:25:37.821463+0000","last_clean":"2024-03-18T18:25:37.821463+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:25:37.821463+0000","last_undegraded":"2024-03-18T18:25:37.821463+0000","last_fullsized":"2024-03-18T18:25:37.821463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3857,"log_dups_size":0,"ondisk_log_size":3857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"54'3360","reported_seq":2804,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749507+0000","last_change":"2024-03-18T18:25:29.046208+0000","last_active":"2024-03-18T18:25:37.749507+0000","last_peered":"2024-03-18T18:25:37.749507+0000","last_clean":"2024-03-18T18:25:37.749507+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:25:37.749507+0000","last_undegraded":"2024-03-18T18:25:37.749507+0000","last_fullsized":"2024-03-18T18:25:37.749507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:05:44.235304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"54'3862","reported_seq":3203,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818687+0000","last_change":"2024-03-18T18:25:29.058196+0000","last_active":"2024-03-18T18:25:37.818687+0000","last_peered":"2024-03-18T18:25:37.818687+0000","last_clean":"2024-03-18T18:25:37.818687+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:25:37.818687+0000","last_undegraded":"2024-03-18T18:25:37.818687+0000","last_fullsized":"2024-03-18T18:25:37.818687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"54'3275","reported_seq":2726,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820468+0000","last_change":"2024-03-18T18:25:29.038378+0000","last_active":"2024-03-18T18:25:37.820468+0000","last_peered":"2024-03-18T18:25:37.820468+0000","last_clean":"2024-03-18T18:25:37.820468+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:25:37.820468+0000","last_undegraded":"2024-03-18T18:25:37.820468+0000","last_fullsized":"2024-03-18T18:25:37.820468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"54'4260","reported_seq":3504,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752406+0000","last_change":"2024-03-18T18:25:29.230579+0000","last_active":"2024-03-18T18:25:37.752406+0000","last_peered":"2024-03-18T18:25:37.752406+0000","last_clean":"2024-03-18T18:25:37.752406+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:37.752406+0000","last_undegraded":"2024-03-18T18:25:37.752406+0000","last_fullsized":"2024-03-18T18:25:37.752406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4260,"log_dups_size":0,"ondisk_log_size":4260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"54'3985","reported_seq":3275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756169+0000","last_change":"2024-03-18T18:25:29.022937+0000","last_active":"2024-03-18T18:25:37.756169+0000","last_peered":"2024-03-18T18:25:37.756169+0000","last_clean":"2024-03-18T18:25:37.756169+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:25:37.756169+0000","last_undegraded":"2024-03-18T18:25:37.756169+0000","last_fullsized":"2024-03-18T18:25:37.756169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:10:32.848033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"54'4040","reported_seq":3314,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818949+0000","last_change":"2024-03-18T18:25:29.190915+0000","last_active":"2024-03-18T18:25:37.818949+0000","last_peered":"2024-03-18T18:25:37.818949+0000","last_clean":"2024-03-18T18:25:37.818949+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:37.818949+0000","last_undegraded":"2024-03-18T18:25:37.818949+0000","last_fullsized":"2024-03-18T18:25:37.818949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4040,"log_dups_size":0,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"48'1439","reported_seq":1490,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.185147+0000","last_change":"2024-03-18T18:09:12.449063+0000","last_active":"2024-03-18T18:25:33.185147+0000","last_peered":"2024-03-18T18:25:33.185147+0000","last_clean":"2024-03-18T18:25:33.185147+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:33.185147+0000","last_undegraded":"2024-03-18T18:25:33.185147+0000","last_fullsized":"2024-03-18T18:25:33.185147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1439,"log_dups_size":0,"ondisk_log_size":1439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:43:38.850486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2984,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819267+0000","last_change":"2024-03-18T18:25:29.062033+0000","last_active":"2024-03-18T18:25:37.819267+0000","last_peered":"2024-03-18T18:25:37.819267+0000","last_clean":"2024-03-18T18:25:37.819267+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:37.819267+0000","last_undegraded":"2024-03-18T18:25:37.819267+0000","last_fullsized":"2024-03-18T18:25:37.819267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"54'3527","reported_seq":3578,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.747025+0000","last_change":"2024-03-18T18:09:12.448556+0000","last_active":"2024-03-18T18:25:32.747025+0000","last_peered":"2024-03-18T18:25:32.747025+0000","last_clean":"2024-03-18T18:25:32.747025+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:32.747025+0000","last_undegraded":"2024-03-18T18:25:32.747025+0000","last_fullsized":"2024-03-18T18:25:32.747025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3527,"log_dups_size":0,"ondisk_log_size":3527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"50'679","reported_seq":730,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.183454+0000","last_change":"2024-03-18T18:09:12.445561+0000","last_active":"2024-03-18T18:25:33.183454+0000","last_peered":"2024-03-18T18:25:33.183454+0000","last_clean":"2024-03-18T18:25:33.183454+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:33.183454+0000","last_undegraded":"2024-03-18T18:25:33.183454+0000","last_fullsized":"2024-03-18T18:25:33.183454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:54:13.492079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"54'4461","reported_seq":3635,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748025+0000","last_change":"2024-03-18T18:25:29.040660+0000","last_active":"2024-03-18T18:25:37.748025+0000","last_peered":"2024-03-18T18:25:37.748025+0000","last_clean":"2024-03-18T18:25:37.748025+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:25:37.748025+0000","last_undegraded":"2024-03-18T18:25:37.748025+0000","last_fullsized":"2024-03-18T18:25:37.748025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.876285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"50'5546","reported_seq":5598,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819826+0000","last_change":"2024-03-18T18:09:12.452315+0000","last_active":"2024-03-18T18:25:37.819826+0000","last_peered":"2024-03-18T18:25:37.819826+0000","last_clean":"2024-03-18T18:25:37.819826+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:37.819826+0000","last_undegraded":"2024-03-18T18:25:37.819826+0000","last_fullsized":"2024-03-18T18:25:37.819826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5546,"log_dups_size":0,"ondisk_log_size":5546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"54'3911","reported_seq":3237,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820491+0000","last_change":"2024-03-18T18:25:29.032708+0000","last_active":"2024-03-18T18:25:37.820491+0000","last_peered":"2024-03-18T18:25:37.820491+0000","last_clean":"2024-03-18T18:25:37.820491+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:25:37.820491+0000","last_undegraded":"2024-03-18T18:25:37.820491+0000","last_fullsized":"2024-03-18T18:25:37.820491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"55'1865","reported_seq":1916,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:36.014851+0000","last_change":"2024-03-18T18:09:12.455010+0000","last_active":"2024-03-18T18:25:36.014851+0000","last_peered":"2024-03-18T18:25:36.014851+0000","last_clean":"2024-03-18T18:25:36.014851+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:36.014851+0000","last_undegraded":"2024-03-18T18:25:36.014851+0000","last_fullsized":"2024-03-18T18:25:36.014851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1865,"log_dups_size":0,"ondisk_log_size":1865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18032374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1972,"num_write_kb":19324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"54'3669","reported_seq":3080,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821500+0000","last_change":"2024-03-18T18:25:29.027139+0000","last_active":"2024-03-18T18:25:37.821500+0000","last_peered":"2024-03-18T18:25:37.821500+0000","last_clean":"2024-03-18T18:25:37.821500+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:25:37.821500+0000","last_undegraded":"2024-03-18T18:25:37.821500+0000","last_fullsized":"2024-03-18T18:25:37.821500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"50'2293","reported_seq":2345,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818462+0000","last_change":"2024-03-18T18:09:12.451296+0000","last_active":"2024-03-18T18:25:37.818462+0000","last_peered":"2024-03-18T18:25:37.818462+0000","last_clean":"2024-03-18T18:25:37.818462+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:37.818462+0000","last_undegraded":"2024-03-18T18:25:37.818462+0000","last_fullsized":"2024-03-18T18:25:37.818462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2293,"log_dups_size":0,"ondisk_log_size":2293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"54'3704","reported_seq":3073,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.822216+0000","last_change":"2024-03-18T18:25:29.055272+0000","last_active":"2024-03-18T18:25:37.822216+0000","last_peered":"2024-03-18T18:25:37.822216+0000","last_clean":"2024-03-18T18:25:37.822216+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:37.822216+0000","last_undegraded":"2024-03-18T18:25:37.822216+0000","last_fullsized":"2024-03-18T18:25:37.822216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"54'2695","reported_seq":2747,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821798+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:25:37.821798+0000","last_peered":"2024-03-18T18:25:37.821798+0000","last_clean":"2024-03-18T18:25:37.821798+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:25:37.821798+0000","last_undegraded":"2024-03-18T18:25:37.821798+0000","last_fullsized":"2024-03-18T18:25:37.821798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"54'3876","reported_seq":3239,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:39.684295+0000","last_change":"2024-03-18T18:25:29.195869+0000","last_active":"2024-03-18T18:25:39.684295+0000","last_peered":"2024-03-18T18:25:39.684295+0000","last_clean":"2024-03-18T18:25:39.684295+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:39.684295+0000","last_undegraded":"2024-03-18T18:25:39.684295+0000","last_fullsized":"2024-03-18T18:25:39.684295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3876,"log_dups_size":0,"ondisk_log_size":3876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"54'3870","reported_seq":3922,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756715+0000","last_change":"2024-03-18T18:09:12.449148+0000","last_active":"2024-03-18T18:25:37.756715+0000","last_peered":"2024-03-18T18:25:37.756715+0000","last_clean":"2024-03-18T18:25:37.756715+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:37.756715+0000","last_undegraded":"2024-03-18T18:25:37.756715+0000","last_fullsized":"2024-03-18T18:25:37.756715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3979,"num_write_kb":30875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"54'3911","reported_seq":3210,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751547+0000","last_change":"2024-03-18T18:25:29.054617+0000","last_active":"2024-03-18T18:25:37.751547+0000","last_peered":"2024-03-18T18:25:37.751547+0000","last_clean":"2024-03-18T18:25:37.751547+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:25:37.751547+0000","last_undegraded":"2024-03-18T18:25:37.751547+0000","last_fullsized":"2024-03-18T18:25:37.751547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:45:58.279294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"50'2794","reported_seq":2847,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.741171+0000","last_change":"2024-03-18T18:09:12.441944+0000","last_active":"2024-03-18T18:25:37.741171+0000","last_peered":"2024-03-18T18:25:37.741171+0000","last_clean":"2024-03-18T18:25:37.741171+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:37.741171+0000","last_undegraded":"2024-03-18T18:25:37.741171+0000","last_fullsized":"2024-03-18T18:25:37.741171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2794,"log_dups_size":0,"ondisk_log_size":2794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"54'3870","reported_seq":3184,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818611+0000","last_change":"2024-03-18T18:25:29.049751+0000","last_active":"2024-03-18T18:25:37.818611+0000","last_peered":"2024-03-18T18:25:37.818611+0000","last_clean":"2024-03-18T18:25:37.818611+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:37.818611+0000","last_undegraded":"2024-03-18T18:25:37.818611+0000","last_fullsized":"2024-03-18T18:25:37.818611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"54'148","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820802+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:25:37.820802+0000","last_peered":"2024-03-18T18:25:37.820802+0000","last_clean":"2024-03-18T18:25:37.820802+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:25:37.820802+0000","last_undegraded":"2024-03-18T18:25:37.820802+0000","last_fullsized":"2024-03-18T18:25:37.820802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3408,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751667+0000","last_change":"2024-03-18T18:25:29.053722+0000","last_active":"2024-03-18T18:25:37.751667+0000","last_peered":"2024-03-18T18:25:37.751667+0000","last_clean":"2024-03-18T18:25:37.751667+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:25:37.751667+0000","last_undegraded":"2024-03-18T18:25:37.751667+0000","last_fullsized":"2024-03-18T18:25:37.751667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:50:21.296809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"54'1127","reported_seq":1179,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:35.648215+0000","last_change":"2024-03-18T18:09:12.445197+0000","last_active":"2024-03-18T18:25:35.648215+0000","last_peered":"2024-03-18T18:25:35.648215+0000","last_clean":"2024-03-18T18:25:35.648215+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:35.648215+0000","last_undegraded":"2024-03-18T18:25:35.648215+0000","last_fullsized":"2024-03-18T18:25:35.648215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:38:30.294582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"54'3649","reported_seq":2974,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756617+0000","last_change":"2024-03-18T18:25:29.016810+0000","last_active":"2024-03-18T18:25:37.756617+0000","last_peered":"2024-03-18T18:25:37.756617+0000","last_clean":"2024-03-18T18:25:37.756617+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:25:37.756617+0000","last_undegraded":"2024-03-18T18:25:37.756617+0000","last_fullsized":"2024-03-18T18:25:37.756617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3649,"log_dups_size":0,"ondisk_log_size":3649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:25:39.070959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"54'1551","reported_seq":1604,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752276+0000","last_change":"2024-03-18T18:09:12.444020+0000","last_active":"2024-03-18T18:25:37.752276+0000","last_peered":"2024-03-18T18:25:37.752276+0000","last_clean":"2024-03-18T18:25:37.752276+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:37.752276+0000","last_undegraded":"2024-03-18T18:25:37.752276+0000","last_fullsized":"2024-03-18T18:25:37.752276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"54'4133","reported_seq":3369,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750705+0000","last_change":"2024-03-18T18:25:29.051925+0000","last_active":"2024-03-18T18:25:37.750705+0000","last_peered":"2024-03-18T18:25:37.750705+0000","last_clean":"2024-03-18T18:25:37.750705+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:25:37.750705+0000","last_undegraded":"2024-03-18T18:25:37.750705+0000","last_fullsized":"2024-03-18T18:25:37.750705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4133,"log_dups_size":0,"ondisk_log_size":4133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:21:39.132579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"48'1388","reported_seq":1441,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821902+0000","last_change":"2024-03-18T18:09:12.441877+0000","last_active":"2024-03-18T18:25:37.821902+0000","last_peered":"2024-03-18T18:25:37.821902+0000","last_clean":"2024-03-18T18:25:37.821902+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:37.821902+0000","last_undegraded":"2024-03-18T18:25:37.821902+0000","last_fullsized":"2024-03-18T18:25:37.821902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"54'3700","reported_seq":3044,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751130+0000","last_change":"2024-03-18T18:25:29.056125+0000","last_active":"2024-03-18T18:25:37.751130+0000","last_peered":"2024-03-18T18:25:37.751130+0000","last_clean":"2024-03-18T18:25:37.751130+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:37.751130+0000","last_undegraded":"2024-03-18T18:25:37.751130+0000","last_fullsized":"2024-03-18T18:25:37.751130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3700,"log_dups_size":0,"ondisk_log_size":3700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:45:24.615232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"50'1377","reported_seq":1430,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.753190+0000","last_change":"2024-03-18T18:09:12.446321+0000","last_active":"2024-03-18T18:25:37.753190+0000","last_peered":"2024-03-18T18:25:37.753190+0000","last_clean":"2024-03-18T18:25:37.753190+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:37.753190+0000","last_undegraded":"2024-03-18T18:25:37.753190+0000","last_fullsized":"2024-03-18T18:25:37.753190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"54'4065","reported_seq":3354,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.753233+0000","last_change":"2024-03-18T18:25:29.226986+0000","last_active":"2024-03-18T18:25:37.753233+0000","last_peered":"2024-03-18T18:25:37.753233+0000","last_clean":"2024-03-18T18:25:37.753233+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:25:37.753233+0000","last_undegraded":"2024-03-18T18:25:37.753233+0000","last_fullsized":"2024-03-18T18:25:37.753233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4065,"log_dups_size":0,"ondisk_log_size":4065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"50'4629","reported_seq":4682,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821991+0000","last_change":"2024-03-18T18:09:12.440136+0000","last_active":"2024-03-18T18:25:37.821991+0000","last_peered":"2024-03-18T18:25:37.821991+0000","last_clean":"2024-03-18T18:25:37.821991+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:37.821991+0000","last_undegraded":"2024-03-18T18:25:37.821991+0000","last_fullsized":"2024-03-18T18:25:37.821991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3739","reported_seq":3064,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821037+0000","last_change":"2024-03-18T18:25:29.033548+0000","last_active":"2024-03-18T18:25:37.821037+0000","last_peered":"2024-03-18T18:25:37.821037+0000","last_clean":"2024-03-18T18:25:37.821037+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:25:37.821037+0000","last_undegraded":"2024-03-18T18:25:37.821037+0000","last_fullsized":"2024-03-18T18:25:37.821037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"48'5034","reported_seq":5087,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752716+0000","last_change":"2024-03-18T18:09:12.452246+0000","last_active":"2024-03-18T18:25:37.752716+0000","last_peered":"2024-03-18T18:25:37.752716+0000","last_clean":"2024-03-18T18:25:37.752716+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:37.752716+0000","last_undegraded":"2024-03-18T18:25:37.752716+0000","last_fullsized":"2024-03-18T18:25:37.752716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5034,"log_dups_size":0,"ondisk_log_size":5034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'3518","reported_seq":2898,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751186+0000","last_change":"2024-03-18T18:25:29.055382+0000","last_active":"2024-03-18T18:25:37.751186+0000","last_peered":"2024-03-18T18:25:37.751186+0000","last_clean":"2024-03-18T18:25:37.751186+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:25:37.751186+0000","last_undegraded":"2024-03-18T18:25:37.751186+0000","last_fullsized":"2024-03-18T18:25:37.751186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3518,"log_dups_size":0,"ondisk_log_size":3518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:00.566254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":206,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.247543+0000","last_change":"2024-03-18T18:09:00.901251+0000","last_active":"2024-03-18T18:25:33.247543+0000","last_peered":"2024-03-18T18:25:33.247543+0000","last_clean":"2024-03-18T18:25:33.247543+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:33.247543+0000","last_undegraded":"2024-03-18T18:25:33.247543+0000","last_fullsized":"2024-03-18T18:25:33.247543+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:08:58.857295+0000","last_clean_scrub_stamp":"2024-03-18T18:08:58.857295+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:23.952520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"50'1920","reported_seq":1973,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820593+0000","last_change":"2024-03-18T18:09:12.450259+0000","last_active":"2024-03-18T18:25:37.820593+0000","last_peered":"2024-03-18T18:25:37.820593+0000","last_clean":"2024-03-18T18:25:37.820593+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:37.820593+0000","last_undegraded":"2024-03-18T18:25:37.820593+0000","last_fullsized":"2024-03-18T18:25:37.820593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748696+0000","last_change":"2024-03-18T18:25:29.046186+0000","last_active":"2024-03-18T18:25:37.748696+0000","last_peered":"2024-03-18T18:25:37.748696+0000","last_clean":"2024-03-18T18:25:37.748696+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:37.748696+0000","last_undegraded":"2024-03-18T18:25:37.748696+0000","last_fullsized":"2024-03-18T18:25:37.748696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:10:23.866317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"50'4975","reported_seq":5028,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.247883+0000","last_change":"2024-03-18T18:09:12.449944+0000","last_active":"2024-03-18T18:25:33.247883+0000","last_peered":"2024-03-18T18:25:33.247883+0000","last_clean":"2024-03-18T18:25:33.247883+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:33.247883+0000","last_undegraded":"2024-03-18T18:25:33.247883+0000","last_fullsized":"2024-03-18T18:25:33.247883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4975,"log_dups_size":0,"ondisk_log_size":4975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:50:35.479334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2935,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818493+0000","last_change":"2024-03-18T18:25:29.042446+0000","last_active":"2024-03-18T18:25:37.818493+0000","last_peered":"2024-03-18T18:25:37.818493+0000","last_clean":"2024-03-18T18:25:37.818493+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:37.818493+0000","last_undegraded":"2024-03-18T18:25:37.818493+0000","last_fullsized":"2024-03-18T18:25:37.818493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"54'2669","reported_seq":3262,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752592+0000","last_change":"2024-03-18T18:09:12.446236+0000","last_active":"2024-03-18T18:25:37.752592+0000","last_peered":"2024-03-18T18:25:37.752592+0000","last_clean":"2024-03-18T18:25:37.752592+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:37.752592+0000","last_undegraded":"2024-03-18T18:25:37.752592+0000","last_fullsized":"2024-03-18T18:25:37.752592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2669,"log_dups_size":0,"ondisk_log_size":2669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"54'4235","reported_seq":3485,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.822701+0000","last_change":"2024-03-18T18:25:29.032416+0000","last_active":"2024-03-18T18:25:37.822701+0000","last_peered":"2024-03-18T18:25:37.822701+0000","last_clean":"2024-03-18T18:25:37.822701+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:25:37.822701+0000","last_undegraded":"2024-03-18T18:25:37.822701+0000","last_fullsized":"2024-03-18T18:25:37.822701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4235,"log_dups_size":0,"ondisk_log_size":4235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"50'5920","reported_seq":5973,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820989+0000","last_change":"2024-03-18T18:09:12.452582+0000","last_active":"2024-03-18T18:25:37.820989+0000","last_peered":"2024-03-18T18:25:37.820989+0000","last_clean":"2024-03-18T18:25:37.820989+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:37.820989+0000","last_undegraded":"2024-03-18T18:25:37.820989+0000","last_fullsized":"2024-03-18T18:25:37.820989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":5920,"log_dups_size":0,"ondisk_log_size":5920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3976","reported_seq":3253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819988+0000","last_change":"2024-03-18T18:25:29.192820+0000","last_active":"2024-03-18T18:25:37.819988+0000","last_peered":"2024-03-18T18:25:37.819988+0000","last_clean":"2024-03-18T18:25:37.819988+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:37.819988+0000","last_undegraded":"2024-03-18T18:25:37.819988+0000","last_fullsized":"2024-03-18T18:25:37.819988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3976,"log_dups_size":0,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"54'954","reported_seq":1007,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820939+0000","last_change":"2024-03-18T18:09:12.443093+0000","last_active":"2024-03-18T18:25:37.820939+0000","last_peered":"2024-03-18T18:25:37.820939+0000","last_clean":"2024-03-18T18:25:37.820939+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:37.820939+0000","last_undegraded":"2024-03-18T18:25:37.820939+0000","last_fullsized":"2024-03-18T18:25:37.820939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"54'3615","reported_seq":3010,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820162+0000","last_change":"2024-03-18T18:25:29.037811+0000","last_active":"2024-03-18T18:25:37.820162+0000","last_peered":"2024-03-18T18:25:37.820162+0000","last_clean":"2024-03-18T18:25:37.820162+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:25:37.820162+0000","last_undegraded":"2024-03-18T18:25:37.820162+0000","last_fullsized":"2024-03-18T18:25:37.820162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"48'3704","reported_seq":3756,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.249805+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:25:33.249805+0000","last_peered":"2024-03-18T18:25:33.249805+0000","last_clean":"2024-03-18T18:25:33.249805+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:25:33.249805+0000","last_undegraded":"2024-03-18T18:25:33.249805+0000","last_fullsized":"2024-03-18T18:25:33.249805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:15:56.432005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820514+0000","last_change":"2024-03-18T18:25:29.039953+0000","last_active":"2024-03-18T18:25:37.820514+0000","last_peered":"2024-03-18T18:25:37.820514+0000","last_clean":"2024-03-18T18:25:37.820514+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:25:37.820514+0000","last_undegraded":"2024-03-18T18:25:37.820514+0000","last_fullsized":"2024-03-18T18:25:37.820514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"54'2145","reported_seq":2198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821967+0000","last_change":"2024-03-18T18:09:12.448424+0000","last_active":"2024-03-18T18:25:37.821967+0000","last_peered":"2024-03-18T18:25:37.821967+0000","last_clean":"2024-03-18T18:25:37.821967+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:37.821967+0000","last_undegraded":"2024-03-18T18:25:37.821967+0000","last_fullsized":"2024-03-18T18:25:37.821967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2145,"log_dups_size":0,"ondisk_log_size":2145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2814,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749963+0000","last_change":"2024-03-18T18:25:29.044961+0000","last_active":"2024-03-18T18:25:37.749963+0000","last_peered":"2024-03-18T18:25:37.749963+0000","last_clean":"2024-03-18T18:25:37.749963+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:25:37.749963+0000","last_undegraded":"2024-03-18T18:25:37.749963+0000","last_fullsized":"2024-03-18T18:25:37.749963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:59.800681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"54'1820","reported_seq":1872,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:32.747737+0000","last_change":"2024-03-18T18:09:12.450352+0000","last_active":"2024-03-18T18:25:32.747737+0000","last_peered":"2024-03-18T18:25:32.747737+0000","last_clean":"2024-03-18T18:25:32.747737+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:32.747737+0000","last_undegraded":"2024-03-18T18:25:32.747737+0000","last_fullsized":"2024-03-18T18:25:32.747737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1820,"log_dups_size":0,"ondisk_log_size":1820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"54'3540","reported_seq":2946,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821008+0000","last_change":"2024-03-18T18:25:29.063216+0000","last_active":"2024-03-18T18:25:37.821008+0000","last_peered":"2024-03-18T18:25:37.821008+0000","last_clean":"2024-03-18T18:25:37.821008+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:37.821008+0000","last_undegraded":"2024-03-18T18:25:37.821008+0000","last_fullsized":"2024-03-18T18:25:37.821008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"48'1602","reported_seq":1654,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.248143+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:25:33.248143+0000","last_peered":"2024-03-18T18:25:33.248143+0000","last_clean":"2024-03-18T18:25:33.248143+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:25:33.248143+0000","last_undegraded":"2024-03-18T18:25:33.248143+0000","last_fullsized":"2024-03-18T18:25:33.248143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1602,"log_dups_size":0,"ondisk_log_size":1602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:14:35.715948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"54'3743","reported_seq":3039,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.822478+0000","last_change":"2024-03-18T18:25:29.194592+0000","last_active":"2024-03-18T18:25:37.822478+0000","last_peered":"2024-03-18T18:25:37.822478+0000","last_clean":"2024-03-18T18:25:37.822478+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:37.822478+0000","last_undegraded":"2024-03-18T18:25:37.822478+0000","last_fullsized":"2024-03-18T18:25:37.822478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3743,"log_dups_size":0,"ondisk_log_size":3743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"50'2478","reported_seq":2531,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820792+0000","last_change":"2024-03-18T18:09:12.448877+0000","last_active":"2024-03-18T18:25:37.820792+0000","last_peered":"2024-03-18T18:25:37.820792+0000","last_clean":"2024-03-18T18:25:37.820792+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:37.820792+0000","last_undegraded":"2024-03-18T18:25:37.820792+0000","last_fullsized":"2024-03-18T18:25:37.820792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2478,"log_dups_size":0,"ondisk_log_size":2478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"54'3993","reported_seq":3322,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748028+0000","last_change":"2024-03-18T18:25:29.042734+0000","last_active":"2024-03-18T18:25:37.748028+0000","last_peered":"2024-03-18T18:25:37.748028+0000","last_clean":"2024-03-18T18:25:37.748028+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:37.748028+0000","last_undegraded":"2024-03-18T18:25:37.748028+0000","last_fullsized":"2024-03-18T18:25:37.748028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:29.449299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"56'2625","reported_seq":2689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:39.120325+0000","last_change":"2024-03-18T18:25:39.120490+0000","last_active":"2024-03-18T18:25:39.120325+0000","last_peered":"2024-03-18T18:25:39.120325+0000","last_clean":"2024-03-18T18:25:39.120325+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:39.120325+0000","last_undegraded":"2024-03-18T18:25:39.120325+0000","last_fullsized":"2024-03-18T18:25:39.120325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2625","last_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_deep_scrub":"56'2625","last_deep_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_clean_scrub_stamp":"2024-03-18T18:25:39.120285+0000","objects_scrubbed":3,"log_size":2625,"log_dups_size":0,"ondisk_log_size":2625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:53.774603+0000","scrub_duration":0.046006920999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'3488","reported_seq":2912,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749038+0000","last_change":"2024-03-18T18:25:29.044854+0000","last_active":"2024-03-18T18:25:37.749038+0000","last_peered":"2024-03-18T18:25:37.749038+0000","last_clean":"2024-03-18T18:25:37.749038+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:25:37.749038+0000","last_undegraded":"2024-03-18T18:25:37.749038+0000","last_fullsized":"2024-03-18T18:25:37.749038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:13:23.616152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"54'4483","reported_seq":4535,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.249194+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:25:33.249194+0000","last_peered":"2024-03-18T18:25:33.249194+0000","last_clean":"2024-03-18T18:25:33.249194+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:25:33.249194+0000","last_undegraded":"2024-03-18T18:25:33.249194+0000","last_fullsized":"2024-03-18T18:25:33.249194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:15.952294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"54'3776","reported_seq":3135,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756154+0000","last_change":"2024-03-18T18:25:29.014675+0000","last_active":"2024-03-18T18:25:37.756154+0000","last_peered":"2024-03-18T18:25:37.756154+0000","last_clean":"2024-03-18T18:25:37.756154+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:25:37.756154+0000","last_undegraded":"2024-03-18T18:25:37.756154+0000","last_fullsized":"2024-03-18T18:25:37.756154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:58:54.452800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"54'3710","reported_seq":3122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819720+0000","last_change":"2024-03-18T18:25:29.035433+0000","last_active":"2024-03-18T18:25:37.819720+0000","last_peered":"2024-03-18T18:25:37.819720+0000","last_clean":"2024-03-18T18:25:37.819720+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:25:37.819720+0000","last_undegraded":"2024-03-18T18:25:37.819720+0000","last_fullsized":"2024-03-18T18:25:37.819720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"51'1387","reported_seq":1438,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.248519+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:25:33.248519+0000","last_peered":"2024-03-18T18:25:33.248519+0000","last_clean":"2024-03-18T18:25:33.248519+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:25:33.248519+0000","last_undegraded":"2024-03-18T18:25:33.248519+0000","last_fullsized":"2024-03-18T18:25:33.248519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:36:02.160214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4103","reported_seq":3381,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821222+0000","last_change":"2024-03-18T18:25:29.032671+0000","last_active":"2024-03-18T18:25:37.821222+0000","last_peered":"2024-03-18T18:25:37.821222+0000","last_clean":"2024-03-18T18:25:37.821222+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:25:37.821222+0000","last_undegraded":"2024-03-18T18:25:37.821222+0000","last_fullsized":"2024-03-18T18:25:37.821222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"54'3530","reported_seq":3581,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.249580+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:25:33.249580+0000","last_peered":"2024-03-18T18:25:33.249580+0000","last_clean":"2024-03-18T18:25:33.249580+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:25:33.249580+0000","last_undegraded":"2024-03-18T18:25:33.249580+0000","last_fullsized":"2024-03-18T18:25:33.249580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3530,"log_dups_size":0,"ondisk_log_size":3530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:12:05.084946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"54'3441","reported_seq":2895,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821654+0000","last_change":"2024-03-18T18:25:29.053757+0000","last_active":"2024-03-18T18:25:37.821654+0000","last_peered":"2024-03-18T18:25:37.821654+0000","last_clean":"2024-03-18T18:25:37.821654+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:25:37.821654+0000","last_undegraded":"2024-03-18T18:25:37.821654+0000","last_fullsized":"2024-03-18T18:25:37.821654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"50'3382","reported_seq":3435,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:33.184811+0000","last_change":"2024-03-18T18:09:12.443362+0000","last_active":"2024-03-18T18:25:33.184811+0000","last_peered":"2024-03-18T18:25:33.184811+0000","last_clean":"2024-03-18T18:25:33.184811+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:33.184811+0000","last_undegraded":"2024-03-18T18:25:33.184811+0000","last_fullsized":"2024-03-18T18:25:33.184811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:03:57.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"54'3368","reported_seq":2787,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749186+0000","last_change":"2024-03-18T18:25:29.047446+0000","last_active":"2024-03-18T18:25:37.749186+0000","last_peered":"2024-03-18T18:25:37.749186+0000","last_clean":"2024-03-18T18:25:37.749186+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:25:37.749186+0000","last_undegraded":"2024-03-18T18:25:37.749186+0000","last_fullsized":"2024-03-18T18:25:37.749186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:18.448209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"50'1528","reported_seq":1581,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.741266+0000","last_change":"2024-03-18T18:09:12.449096+0000","last_active":"2024-03-18T18:25:37.741266+0000","last_peered":"2024-03-18T18:25:37.741266+0000","last_clean":"2024-03-18T18:25:37.741266+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:37.741266+0000","last_undegraded":"2024-03-18T18:25:37.741266+0000","last_fullsized":"2024-03-18T18:25:37.741266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":75039,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241948,"ondisk_log_size":241948,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264990062,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88599,"num_write_kb":695434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":530046976,"data_stored":529980124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85084,"ondisk_log_size":85084,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404728,"kb_used_data":66800,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967112,"statfs":{"total":96636764160,"available":96222322688,"internally_reserved":0,"allocated":68403200,"data_stored":68027641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.78800000000000003,"15min":0.73199999999999998},"min":{"1min":0.35599999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":13.092000000000001,"5min":13.092000000000001,"15min":13.092000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.087,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.3760000000000003,"5min":6.3760000000000003,"15min":6.3760000000000003},"last":0.83699999999999997}]},{"osd":1,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.206,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.73999999999999999,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.5009999999999999},"last":0.88700000000000001}]},{"osd":2,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69199999999999995,"15min":0.749},"min":{"1min":0.38900000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0880000000000001,"5min":1.115,"15min":1.3700000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1579999999999999,"5min":1.655,"15min":5.452},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79700000000000004,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.82799999999999996,"15min":0.90000000000000002},"min":{"1min":0.44800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":2.5859999999999999},"last":0.92700000000000005}]},{"osd":4,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71599999999999997,"15min":0.76100000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.296,"5min":1.726,"15min":1.726},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":2.085,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.78000000000000003,"15min":0.89100000000000001},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":4.1150000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.153,"5min":0.89700000000000002,"15min":0.95299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.968,"5min":1.968,"15min":4.2350000000000003},"last":1.0609999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":1.444,"5min":3.024,"15min":4.1840000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.86799999999999999,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.476,"5min":3.1709999999999998,"15min":5.431},"last":1.0329999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476940,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367556,"kb_used_data":79736,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94004284,"statfs":{"total":96636764160,"available":96260386816,"internally_reserved":0,"allocated":81649664,"data_stored":81283602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.76200000000000001},"min":{"1min":0.28899999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1060000000000001,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.872},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91800000000000004,"15min":0.84099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.224,"5min":10.127000000000001,"15min":10.127000000000001},"last":1.0209999999999999}]},{"osd":1,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95099999999999996,"15min":0.81999999999999995},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":12.565,"15min":12.565},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.087,"15min":0.88300000000000001},"min":{"1min":0.42199999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":16.579999999999998,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.79500000000000004}]},{"osd":2,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.76400000000000001},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.6859999999999999,"5min":6.202,"15min":6.202},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.157,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.622}]},{"osd":3,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.98799999999999999,"15min":0.90200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.1320000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.113,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.33500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.208,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":1.151},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.45000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.726,"5min":10.08,"15min":10.08},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.83199999999999996,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":27.231000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.054,"15min":1.113},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.351,"5min":9.2509999999999994,"15min":27.478999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.56999999999999995,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4570000000000001,"5min":10.182,"15min":10.182},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.02,"5min":0.86099999999999999,"15min":0.95499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.474,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0429999999999999}]}]},{"osd":5,"up_from":16,"seq":68719476940,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514436,"kb_used_data":104312,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93857404,"statfs":{"total":96636764160,"available":96109981696,"internally_reserved":0,"allocated":106815488,"data_stored":106436602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":2.073,"5min":2.073,"15min":3.6739999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.7150000000000001,"5min":0.874,"15min":0.80800000000000005},"min":{"1min":0.57399999999999995,"5min":0.255,"15min":0.255},"max":{"1min":20.013000000000002,"5min":20.013000000000002,"15min":20.013000000000002},"last":0.58499999999999996}]},{"osd":1,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":7.2469999999999999,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.624},{"interface":"front","average":{"1min":1.3160000000000001,"5min":0.85799999999999998,"15min":0.83199999999999996},"min":{"1min":0.48199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.231,"5min":10.231,"15min":10.231},"last":1.0509999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":0.876,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.041,"5min":12.041,"15min":12.041},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.317,"15min":0.317},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":0.999,"15min":0.92600000000000005},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":16.183,"5min":16.183,"15min":16.183},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.125,"5min":0.89000000000000001,"15min":0.97199999999999998},"min":{"1min":0.61799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":13.678000000000001},"last":0.90900000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.71499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.85799999999999998,"15min":0.90300000000000002},"min":{"1min":0.74399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":1.1220000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.89000000000000001,"15min":0.93200000000000005},"min":{"1min":0.66300000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.89000000000000001,"15min":0.94499999999999995},"min":{"1min":0.64800000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":1.02}]},{"osd":7,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.0860000000000001,"15min":1.0549999999999999},"min":{"1min":0.63500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.766,"5min":12.766,"15min":12.766},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.716,"5min":1.091,"15min":1.083},"min":{"1min":0.77700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":12.788,"5min":12.788,"15min":12.788},"last":1.091}]}]},{"osd":4,"up_from":16,"seq":68719476938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":422124,"kb_used_data":53920,"kb_used_omap":1,"kb_used_meta":368190,"kb_avail":93949716,"statfs":{"total":96636764160,"available":96204509184,"internally_reserved":0,"allocated":55214080,"data_stored":54845832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":377027015},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.74199999999999999,"15min":0.71799999999999997},"min":{"1min":0.42599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2629999999999999,"5min":2.536,"15min":2.536},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.65100000000000002,"15min":0.69499999999999995},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":1.335,"15min":1.946},"last":0.54500000000000004}]},{"osd":1,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.39000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.081,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.754,"5min":0.92600000000000005,"15min":0.86199999999999999},"min":{"1min":0.498,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":17.451000000000001,"5min":17.451000000000001,"15min":17.451000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.48299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.202,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.81699999999999995,"15min":0.84999999999999998},"min":{"1min":0.55000000000000004,"5min":0.31,"15min":0.31},"max":{"1min":1.698,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.85299999999999998}]},{"osd":3,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.6799999999999999,"5min":2.681,"15min":2.681},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.631,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.96399999999999997}]},{"osd":5,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.78300000000000003,"15min":0.84699999999999998},"min":{"1min":0.52500000000000002,"5min":0.307,"15min":0.251},"max":{"1min":1.3069999999999999,"5min":2.613,"15min":4.7119999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.80400000000000005,"15min":0.88500000000000001},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":1.357,"5min":1.393,"15min":4.7480000000000002},"last":0.92500000000000004}]},{"osd":6,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.88100000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3540000000000001,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.099,"5min":0.90300000000000002,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.7749999999999999,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":1.0960000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.85999999999999999,"15min":0.93600000000000005},"min":{"1min":0.439,"5min":0.31,"15min":0.31},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":3.96},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":0.98299999999999998,"15min":1.028},"min":{"1min":0.67200000000000004,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.5509999999999999,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.056}]}]},{"osd":2,"up_from":15,"seq":64424509643,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260840,"kb_used_data":45212,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111000,"statfs":{"total":96636764160,"available":96369664000,"internally_reserved":0,"allocated":46297088,"data_stored":45936802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":0.80900000000000005,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.56100000000000005,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.88300000000000001}]},{"osd":1,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.99299999999999999,"5min":1.1759999999999999,"15min":1.3149999999999999},"last":0.749},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.028,"5min":1.1839999999999999,"15min":1.3},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84699999999999998,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.254,"15min":0.254},"max":{"1min":0.91000000000000003,"5min":12.778,"15min":12.778},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.94999999999999996,"15min":0.82499999999999996},"min":{"1min":0.55700000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5780000000000001,"5min":12.84,"15min":12.84},"last":0.85399999999999998}]},{"osd":4,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.026,"5min":1.526,"15min":1.526},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.99199999999999999,"15min":0.95799999999999996},"min":{"1min":0.745,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2649999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":0.95499999999999996}]},{"osd":5,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.095,"15min":1.0089999999999999},"min":{"1min":0.48499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3939999999999999,"5min":12.807,"15min":12.807},"last":1.224},{"interface":"front","average":{"1min":2.3130000000000002,"5min":1.4370000000000001,"15min":1.1220000000000001},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":24.102,"5min":24.102,"15min":24.102},"last":1.3540000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.016,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4079999999999999,"5min":1.4810000000000001,"15min":2.4260000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.038,"15min":1.038},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.327}]},{"osd":7,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0489999999999999,"15min":1.0409999999999999},"min":{"1min":0.67800000000000005,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.133,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.268},{"interface":"front","average":{"1min":1.107,"5min":1.0449999999999999,"15min":1.069},"min":{"1min":0.78100000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3400000000000001,"5min":1.518,"15min":1.8320000000000001},"last":1.1699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509643,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410672,"kb_used_data":90788,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961168,"statfs":{"total":96636764160,"available":96216236032,"internally_reserved":0,"allocated":92966912,"data_stored":92594645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.1359999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.0189999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.71499999999999997}]},{"osd":2,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0620000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.60199999999999998}]},{"osd":3,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.80800000000000005},"min":{"1min":0.38100000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.0289999999999999,"5min":2.8170000000000002,"15min":4.069},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":0.68500000000000005}]},{"osd":4,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.88700000000000001,"15min":0.86399999999999999},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.339,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.212}]},{"osd":5,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2130000000000001,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":1.157}]},{"osd":6,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0740000000000001},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.29,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.012},{"interface":"front","average":{"1min":1.095,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.48699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.085}]},{"osd":7,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.56000000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2370000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.119},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":4.1509999999999998,"5min":4.1509999999999998,"15min":4.798},"last":1.1830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542347,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319172,"kb_used_data":49336,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052668,"statfs":{"total":96636764160,"available":96309932032,"internally_reserved":0,"allocated":50520064,"data_stored":50148196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1659999999999999,"5min":0.77800000000000002,"15min":0.71299999999999997},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":11.132,"5min":11.132,"15min":11.132},"last":0.83099999999999996}]},{"osd":1,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.30199999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.421,"5min":1.857,"15min":3.3839999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.86399999999999999,"15min":0.78200000000000003},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.331,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.755}]},{"osd":4,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.872,"15min":0.876},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.95999999999999996,"15min":0.94699999999999995},"min":{"1min":0.504,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":2.609,"15min":2.609},"last":1.03}]},{"osd":5,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":1.008},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.587,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.6259999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":1.329},{"interface":"front","average":{"1min":1.095,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.99299999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.157,"15min":1.0860000000000001},"min":{"1min":0.54600000000000004,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":13.02,"5min":13.02,"15min":13.02},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":1.893,"15min":1.9139999999999999},"last":1.3999999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542346,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263668,"kb_used_data":34024,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108172,"statfs":{"total":96636764160,"available":96366768128,"internally_reserved":0,"allocated":34840576,"data_stored":34469140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.68000000000000005,"15min":0.621},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.0229999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.37,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.0140000000000002,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.84599999999999997}]},{"osd":2,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96599999999999997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.755}]},{"osd":3,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.82199999999999995,"15min":0.77100000000000002},"min":{"1min":0.41199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.626},{"interface":"front","average":{"1min":1.226,"5min":0.93000000000000005,"15min":0.85599999999999998},"min":{"1min":0.48399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.80000000000000004}]},{"osd":4,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.66000000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.125,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":0.92200000000000004}]},{"osd":5,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0169999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":5.0650000000000004,"5min":14.869,"15min":14.869},"last":1.016},{"interface":"front","average":{"1min":1.012,"5min":1.0880000000000001,"15min":1.022},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4870000000000001,"5min":14.804,"15min":14.804},"last":1.1659999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.157,"15min":1.0660000000000001},"min":{"1min":0.64300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.4049999999999994,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4259999999999999,"5min":2.113,"15min":2.113},"last":1.2310000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.455,"5min":11.455,"15min":11.455},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.294,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":11.430999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.137}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106119168,"data_stored":106112848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80957440,"data_stored":80947606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":32851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":45093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":36924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:25:41.507 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.507 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.507 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.507 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.507 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.508 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.509 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.510 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.510 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.510 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.510 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.510 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.510 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.511 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.511 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.511 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.511 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.511 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.511 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.512 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.513 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.514 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.514 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.514 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.514 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.514 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.514 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.515 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.516 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T18:08:58.857295+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=8, tm_sec=58, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.517 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.517 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.517 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.517 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.517 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.517 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.518 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.518 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.518 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.518 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.518 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.518 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.519 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.519 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.519 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.519 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.519 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.519 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.520 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.521 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.521 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.521 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.521 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.521 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.521 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:25:41.522 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T18:25:51.923 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:51.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:01.522 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:26:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 Processor -- start 2024-03-18T18:26:01.645 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 -- start start 2024-03-18T18:26:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f35f80b13a0 0x7f35f8144300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f8144840 0x7f35f813e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35f813e750 0x7f35f80b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f8070560 con 0x7f35f80b13a0 2024-03-18T18:26:01.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80b3790 con 0x7f35f813e750 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35fc996700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80b1780 con 0x7f35f8144840 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f35f80b13a0 0x7f35f8144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f35f80b13a0 0x7f35f8144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32862/0 (socket says 172.21.15.94:32862) 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 -- 172.21.15.94:0/2150726493 learned_addr learned my addr 172.21.15.94:0/2150726493 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f7fff700 1 --2- 172.21.15.94:0/2150726493 >> v2:172.21.15.151:3300/0 conn(0x7f35f813e750 0x7f35f80b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f6ffd700 1 --2- 172.21.15.94:0/2150726493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f8144840 0x7f35f813e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 -- 172.21.15.94:0/2150726493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f8144840 msgr2=0x7f35f813e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 --2- 172.21.15.94:0/2150726493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f8144840 0x7f35f813e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 -- 172.21.15.94:0/2150726493 >> v2:172.21.15.151:3300/0 conn(0x7f35f813e750 msgr2=0x7f35f80b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 --2- 172.21.15.94:0/2150726493 >> v2:172.21.15.151:3300/0 conn(0x7f35f813e750 0x7f35f80b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 -- 172.21.15.94:0/2150726493 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80b3a30 con 0x7f35f80b13a0 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f7fff700 1 --2- 172.21.15.94:0/2150726493 >> v2:172.21.15.151:3300/0 conn(0x7f35f813e750 0x7f35f80b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f77fe700 1 --2- 172.21.15.94:0/2150726493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f80b13a0 0x7f35f8144300 secure :-1 s=READY pgs=4528 cs=0 l=1 rev1=1 crypto rx=0x7f35f80b1fc0 tx=0x7f35ec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493545306bcf2336 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f67fc700 1 -- 172.21.15.94:0/2150726493 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec011830 con 0x7f35f80b13a0 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f67fc700 1 -- 172.21.15.94:0/2150726493 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec011990 con 0x7f35f80b13a0 2024-03-18T18:26:01.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.643+0000 7f35f67fc700 1 -- 172.21.15.94:0/2150726493 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec011d20 con 0x7f35f80b13a0 2024-03-18T18:26:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- 172.21.15.94:0/2150726493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f80b13a0 msgr2=0x7f35f8144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- 172.21.15.94:0/2150726493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f80b13a0 0x7f35f8144300 secure :-1 s=READY pgs=4528 cs=0 l=1 rev1=1 crypto rx=0x7f35f80b1fc0 tx=0x7f35ec009bf0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- 172.21.15.94:0/2150726493 shutdown_connections 2024-03-18T18:26:01.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- 172.21.15.94:0/2150726493 >> v2:172.21.15.151:3300/0 conn(0x7f35f813e750 0x7f35f80b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- 172.21.15.94:0/2150726493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f8144840 0x7f35f813e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- 172.21.15.94:0/2150726493 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f80b13a0 0x7f35f8144300 unknown :-1 s=CLOSED pgs=4528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- 172.21.15.94:0/2150726493 >> 172.21.15.94:0/2150726493 conn(0x7f35f80b7a20 msgr2=0x7f35f80b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- 172.21.15.94:0/2150726493 shutdown_connections 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- 172.21.15.94:0/2150726493 wait complete. 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 Processor -- start 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- start start 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f80b13a0 0x7f35f813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 0x7f35f813cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35f8144840 0x7f35f80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f813f930 con 0x7f35f813e750 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80b0570 con 0x7f35f8144840 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35fc996700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8140a30 con 0x7f35f80b13a0 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 0x7f35f813cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 0x7f35f813cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:32878/0 (socket says 172.21.15.94:32878) 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 -- 172.21.15.94:0/2401282647 learned_addr learned my addr 172.21.15.94:0/2401282647 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f7fff700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35f8144840 0x7f35f80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f77fe700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f80b13a0 0x7f35f813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 -- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f80b13a0 msgr2=0x7f35f813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:01.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f80b13a0 0x7f35f813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 -- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35f8144840 msgr2=0x7f35f80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:01.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35f8144840 0x7f35f80b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 -- 172.21.15.94:0/2401282647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec009570 con 0x7f35f813e750 2024-03-18T18:26:01.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.647+0000 7f35f6ffd700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 0x7f35f813cf60 secure :-1 s=READY pgs=4529 cs=0 l=1 rev1=1 crypto rx=0x7f35e800ebe0 tx=0x7f35e800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8009740 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e800c850 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f8141080 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e800cbe0 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f8140750 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f806fd70 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f35e800cd40 con 0x7f35f813e750 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.651+0000 7f35dffff700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f35e4066760 0x7f35e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:01.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.655+0000 7f35f77fe700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f35e4066760 0x7f35e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:01.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.655+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f35e8084170 con 0x7f35f813e750 2024-03-18T18:26:01.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.655+0000 7f35f77fe700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f35e4066760 0x7f35e4068c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000c00 tx=0x7f35ec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:01.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.659+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f35e8051440 con 0x7f35f813e750 2024-03-18T18:26:01.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.827+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35f806f730 con 0x7f35e4066760 2024-03-18T18:26:01.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.835+0000 7f35dffff700 1 -- 172.21.15.94:0/2401282647 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289871 (secure 0 0 0) 0x7f35ec012b90 con 0x7f35e4066760 2024-03-18T18:26:01.842 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.839+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f35e4066760 msgr2=0x7f35e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.839+0000 7f35fc996700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f35e4066760 0x7f35e4068c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000c00 tx=0x7f35ec008030 comp rx=0 tx=0).stop 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 msgr2=0x7f35f813cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 0x7f35f813cf60 secure :-1 s=READY pgs=4529 cs=0 l=1 rev1=1 crypto rx=0x7f35e800ebe0 tx=0x7f35e800eef0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 shutdown_connections 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f35e4066760 0x7f35e4068c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35f8144840 0x7f35f80b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35f813e750 0x7f35f813cf60 unknown :-1 s=CLOSED pgs=4529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 --2- 172.21.15.94:0/2401282647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35f80b13a0 0x7f35f813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:01.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 >> 172.21.15.94:0/2401282647 conn(0x7f35f80b7a20 msgr2=0x7f35f8138f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:01.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 shutdown_connections 2024-03-18T18:26:01.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:01.843+0000 7f35fc996700 1 -- 172.21.15.94:0/2401282647 wait complete. 2024-03-18T18:26:01.846 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:26:01.857 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2024-03-18T18:26:00.923278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265707618,"num_objects":228,"num_object_clones":28,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":15,"num_read":1722,"num_read_kb":4075,"num_write":163797,"num_write_kb":738450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34441,"num_omap_keys":67,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327258,"ondisk_log_size":327258,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2946784,"kb_used_data":524128,"kb_used_omap":12,"kb_used_meta":2422579,"kb_avail":752027936,"statfs":{"total":773094113280,"available":770076606464,"internally_reserved":0,"allocated":536707072,"data_stored":533742460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2480721468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004421"},"pg_stats":[{"pgid":"3.3f","version":"54'3532","reported_seq":2944,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.145813+0000","last_change":"2024-03-18T18:25:29.057112+0000","last_active":"2024-03-18T18:25:41.145813+0000","last_peered":"2024-03-18T18:25:41.145813+0000","last_clean":"2024-03-18T18:25:41.145813+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:25:41.145813+0000","last_undegraded":"2024-03-18T18:25:41.145813+0000","last_fullsized":"2024-03-18T18:25:41.145813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"54'3322","reported_seq":2751,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:38.208840+0000","last_change":"2024-03-18T18:25:29.045338+0000","last_active":"2024-03-18T18:25:38.208840+0000","last_peered":"2024-03-18T18:25:38.208840+0000","last_clean":"2024-03-18T18:25:38.208840+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:25:38.208840+0000","last_undegraded":"2024-03-18T18:25:38.208840+0000","last_fullsized":"2024-03-18T18:25:38.208840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"54'3570","reported_seq":2986,"reported_epoch":56,"state":"active+clean+scrubbing+deep","last_fresh":"2024-03-18T18:25:58.773613+0000","last_change":"2024-03-18T18:25:58.772389+0000","last_active":"2024-03-18T18:25:58.773613+0000","last_peered":"2024-03-18T18:25:58.773613+0000","last_clean":"2024-03-18T18:25:58.773613+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:58.773613+0000","last_undegraded":"2024-03-18T18:25:58.773613+0000","last_fullsized":"2024-03-18T18:25:58.773613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3570,"log_dups_size":0,"ondisk_log_size":3570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"54'3829","reported_seq":3141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820459+0000","last_change":"2024-03-18T18:25:29.029488+0000","last_active":"2024-03-18T18:25:37.820459+0000","last_peered":"2024-03-18T18:25:37.820459+0000","last_clean":"2024-03-18T18:25:37.820459+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:25:37.820459+0000","last_undegraded":"2024-03-18T18:25:37.820459+0000","last_fullsized":"2024-03-18T18:25:37.820459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"54'3564","reported_seq":2931,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751153+0000","last_change":"2024-03-18T18:25:29.053880+0000","last_active":"2024-03-18T18:25:37.751153+0000","last_peered":"2024-03-18T18:25:37.751153+0000","last_clean":"2024-03-18T18:25:37.751153+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:25:37.751153+0000","last_undegraded":"2024-03-18T18:25:37.751153+0000","last_fullsized":"2024-03-18T18:25:37.751153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"54'3681","reported_seq":3012,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752347+0000","last_change":"2024-03-18T18:25:29.226526+0000","last_active":"2024-03-18T18:25:37.752347+0000","last_peered":"2024-03-18T18:25:37.752347+0000","last_clean":"2024-03-18T18:25:37.752347+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:25:37.752347+0000","last_undegraded":"2024-03-18T18:25:37.752347+0000","last_fullsized":"2024-03-18T18:25:37.752347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"54'3919","reported_seq":3245,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750631+0000","last_change":"2024-03-18T18:25:29.050955+0000","last_active":"2024-03-18T18:25:37.750631+0000","last_peered":"2024-03-18T18:25:37.750631+0000","last_clean":"2024-03-18T18:25:37.750631+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:25:37.750631+0000","last_undegraded":"2024-03-18T18:25:37.750631+0000","last_fullsized":"2024-03-18T18:25:37.750631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"54'3528","reported_seq":2941,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752081+0000","last_change":"2024-03-18T18:25:29.224146+0000","last_active":"2024-03-18T18:25:37.752081+0000","last_peered":"2024-03-18T18:25:37.752081+0000","last_clean":"2024-03-18T18:25:37.752081+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:25:37.752081+0000","last_undegraded":"2024-03-18T18:25:37.752081+0000","last_fullsized":"2024-03-18T18:25:37.752081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"54'3888","reported_seq":3249,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752485+0000","last_change":"2024-03-18T18:25:29.056418+0000","last_active":"2024-03-18T18:25:37.752485+0000","last_peered":"2024-03-18T18:25:37.752485+0000","last_clean":"2024-03-18T18:25:37.752485+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:25:37.752485+0000","last_undegraded":"2024-03-18T18:25:37.752485+0000","last_fullsized":"2024-03-18T18:25:37.752485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"54'3828","reported_seq":3247,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.757150+0000","last_change":"2024-03-18T18:25:29.022953+0000","last_active":"2024-03-18T18:25:37.757150+0000","last_peered":"2024-03-18T18:25:37.757150+0000","last_clean":"2024-03-18T18:25:37.757150+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:25:37.757150+0000","last_undegraded":"2024-03-18T18:25:37.757150+0000","last_fullsized":"2024-03-18T18:25:37.757150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"54'3542","reported_seq":2969,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756565+0000","last_change":"2024-03-18T18:25:29.017560+0000","last_active":"2024-03-18T18:25:37.756565+0000","last_peered":"2024-03-18T18:25:37.756565+0000","last_clean":"2024-03-18T18:25:37.756565+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:25:37.756565+0000","last_undegraded":"2024-03-18T18:25:37.756565+0000","last_fullsized":"2024-03-18T18:25:37.756565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"54'4127","reported_seq":3434,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:55.455261+0000","last_change":"2024-03-18T18:25:55.455436+0000","last_active":"2024-03-18T18:25:55.455261+0000","last_peered":"2024-03-18T18:25:55.455261+0000","last_clean":"2024-03-18T18:25:55.455261+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:55.455261+0000","last_undegraded":"2024-03-18T18:25:55.455261+0000","last_fullsized":"2024-03-18T18:25:55.455261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4127","last_scrub_stamp":"2024-03-18T18:25:55.455217+0000","last_deep_scrub":"54'4127","last_deep_scrub_stamp":"2024-03-18T18:25:55.455217+0000","last_clean_scrub_stamp":"2024-03-18T18:25:55.455217+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:39:08.916529+0000","scrub_duration":0.047245723000000003,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"54'3608","reported_seq":3017,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748183+0000","last_change":"2024-03-18T18:25:29.043841+0000","last_active":"2024-03-18T18:25:37.748183+0000","last_peered":"2024-03-18T18:25:37.748183+0000","last_clean":"2024-03-18T18:25:37.748183+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:25:37.748183+0000","last_undegraded":"2024-03-18T18:25:37.748183+0000","last_fullsized":"2024-03-18T18:25:37.748183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"56'3872","reported_seq":3185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:57.777261+0000","last_change":"2024-03-18T18:25:57.777426+0000","last_active":"2024-03-18T18:25:57.777261+0000","last_peered":"2024-03-18T18:25:57.777261+0000","last_clean":"2024-03-18T18:25:57.777261+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:57.777261+0000","last_undegraded":"2024-03-18T18:25:57.777261+0000","last_fullsized":"2024-03-18T18:25:57.777261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3872","last_scrub_stamp":"2024-03-18T18:25:57.777233+0000","last_deep_scrub":"56'3872","last_deep_scrub_stamp":"2024-03-18T18:25:57.777233+0000","last_clean_scrub_stamp":"2024-03-18T18:25:57.777233+0000","objects_scrubbed":1,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:16:52.332974+0000","scrub_duration":0.035250040000000003,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"54'3829","reported_seq":3155,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820585+0000","last_change":"2024-03-18T18:25:29.032597+0000","last_active":"2024-03-18T18:25:37.820585+0000","last_peered":"2024-03-18T18:25:37.820585+0000","last_clean":"2024-03-18T18:25:37.820585+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:25:37.820585+0000","last_undegraded":"2024-03-18T18:25:37.820585+0000","last_fullsized":"2024-03-18T18:25:37.820585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"54'4022","reported_seq":3334,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818024+0000","last_change":"2024-03-18T18:25:29.024791+0000","last_active":"2024-03-18T18:25:37.818024+0000","last_peered":"2024-03-18T18:25:37.818024+0000","last_clean":"2024-03-18T18:25:37.818024+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:25:37.818024+0000","last_undegraded":"2024-03-18T18:25:37.818024+0000","last_fullsized":"2024-03-18T18:25:37.818024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"54'3796","reported_seq":3105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819379+0000","last_change":"2024-03-18T18:25:29.030461+0000","last_active":"2024-03-18T18:25:37.819379+0000","last_peered":"2024-03-18T18:25:37.819379+0000","last_clean":"2024-03-18T18:25:37.819379+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:25:37.819379+0000","last_undegraded":"2024-03-18T18:25:37.819379+0000","last_fullsized":"2024-03-18T18:25:37.819379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"56'3742","reported_seq":3157,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.967487+0000","last_change":"2024-03-18T18:25:46.967699+0000","last_active":"2024-03-18T18:25:46.967487+0000","last_peered":"2024-03-18T18:25:46.967487+0000","last_clean":"2024-03-18T18:25:46.967487+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:46.967487+0000","last_undegraded":"2024-03-18T18:25:46.967487+0000","last_fullsized":"2024-03-18T18:25:46.967487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3742","last_scrub_stamp":"2024-03-18T18:25:46.967421+0000","last_deep_scrub":"56'3742","last_deep_scrub_stamp":"2024-03-18T18:25:46.967421+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.967421+0000","objects_scrubbed":4,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:39:00.428733+0000","scrub_duration":0.041615524000000001,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"54'3972","reported_seq":3276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752253+0000","last_change":"2024-03-18T18:25:29.055765+0000","last_active":"2024-03-18T18:25:37.752253+0000","last_peered":"2024-03-18T18:25:37.752253+0000","last_clean":"2024-03-18T18:25:37.752253+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:25:37.752253+0000","last_undegraded":"2024-03-18T18:25:37.752253+0000","last_fullsized":"2024-03-18T18:25:37.752253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"54'3755","reported_seq":3117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756439+0000","last_change":"2024-03-18T18:25:29.019398+0000","last_active":"2024-03-18T18:25:37.756439+0000","last_peered":"2024-03-18T18:25:37.756439+0000","last_clean":"2024-03-18T18:25:37.756439+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:25:37.756439+0000","last_undegraded":"2024-03-18T18:25:37.756439+0000","last_fullsized":"2024-03-18T18:25:37.756439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"54'3495","reported_seq":2916,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818666+0000","last_change":"2024-03-18T18:25:29.059001+0000","last_active":"2024-03-18T18:25:37.818666+0000","last_peered":"2024-03-18T18:25:37.818666+0000","last_clean":"2024-03-18T18:25:37.818666+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:25:37.818666+0000","last_undegraded":"2024-03-18T18:25:37.818666+0000","last_fullsized":"2024-03-18T18:25:37.818666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3495,"log_dups_size":0,"ondisk_log_size":3495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"54'4356","reported_seq":3576,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820036+0000","last_change":"2024-03-18T18:25:29.035858+0000","last_active":"2024-03-18T18:25:37.820036+0000","last_peered":"2024-03-18T18:25:37.820036+0000","last_clean":"2024-03-18T18:25:37.820036+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:25:37.820036+0000","last_undegraded":"2024-03-18T18:25:37.820036+0000","last_fullsized":"2024-03-18T18:25:37.820036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4356,"log_dups_size":0,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"54'3901","reported_seq":3235,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748230+0000","last_change":"2024-03-18T18:25:29.040440+0000","last_active":"2024-03-18T18:25:37.748230+0000","last_peered":"2024-03-18T18:25:37.748230+0000","last_clean":"2024-03-18T18:25:37.748230+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:25:37.748230+0000","last_undegraded":"2024-03-18T18:25:37.748230+0000","last_fullsized":"2024-03-18T18:25:37.748230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"54'4190","reported_seq":3411,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818932+0000","last_change":"2024-03-18T18:25:29.027847+0000","last_active":"2024-03-18T18:25:37.818932+0000","last_peered":"2024-03-18T18:25:37.818932+0000","last_clean":"2024-03-18T18:25:37.818932+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:25:37.818932+0000","last_undegraded":"2024-03-18T18:25:37.818932+0000","last_fullsized":"2024-03-18T18:25:37.818932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"54'3282","reported_seq":2726,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749830+0000","last_change":"2024-03-18T18:25:29.043669+0000","last_active":"2024-03-18T18:25:37.749830+0000","last_peered":"2024-03-18T18:25:37.749830+0000","last_clean":"2024-03-18T18:25:37.749830+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:25:37.749830+0000","last_undegraded":"2024-03-18T18:25:37.749830+0000","last_fullsized":"2024-03-18T18:25:37.749830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"54'3785","reported_seq":3148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.757298+0000","last_change":"2024-03-18T18:25:29.022945+0000","last_active":"2024-03-18T18:25:37.757298+0000","last_peered":"2024-03-18T18:25:37.757298+0000","last_clean":"2024-03-18T18:25:37.757298+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:25:37.757298+0000","last_undegraded":"2024-03-18T18:25:37.757298+0000","last_fullsized":"2024-03-18T18:25:37.757298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"54'3857","reported_seq":3176,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821463+0000","last_change":"2024-03-18T18:25:29.046199+0000","last_active":"2024-03-18T18:25:37.821463+0000","last_peered":"2024-03-18T18:25:37.821463+0000","last_clean":"2024-03-18T18:25:37.821463+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:25:37.821463+0000","last_undegraded":"2024-03-18T18:25:37.821463+0000","last_fullsized":"2024-03-18T18:25:37.821463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3857,"log_dups_size":0,"ondisk_log_size":3857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"54'3360","reported_seq":2805,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749549+0000","last_change":"2024-03-18T18:25:29.046208+0000","last_active":"2024-03-18T18:25:37.749549+0000","last_peered":"2024-03-18T18:25:37.749549+0000","last_clean":"2024-03-18T18:25:37.749549+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:25:37.749549+0000","last_undegraded":"2024-03-18T18:25:37.749549+0000","last_fullsized":"2024-03-18T18:25:37.749549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"54'3862","reported_seq":3204,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818814+0000","last_change":"2024-03-18T18:25:29.058196+0000","last_active":"2024-03-18T18:25:37.818814+0000","last_peered":"2024-03-18T18:25:37.818814+0000","last_clean":"2024-03-18T18:25:37.818814+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:25:37.818814+0000","last_undegraded":"2024-03-18T18:25:37.818814+0000","last_fullsized":"2024-03-18T18:25:37.818814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3862,"log_dups_size":0,"ondisk_log_size":3862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"54'3275","reported_seq":2727,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.180105+0000","last_change":"2024-03-18T18:25:29.038378+0000","last_active":"2024-03-18T18:25:40.180105+0000","last_peered":"2024-03-18T18:25:40.180105+0000","last_clean":"2024-03-18T18:25:40.180105+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:25:40.180105+0000","last_undegraded":"2024-03-18T18:25:40.180105+0000","last_fullsized":"2024-03-18T18:25:40.180105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"56'4262","reported_seq":3518,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.968689+0000","last_change":"2024-03-18T18:25:47.968689+0000","last_active":"2024-03-18T18:25:47.968689+0000","last_peered":"2024-03-18T18:25:47.968689+0000","last_clean":"2024-03-18T18:25:47.968689+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:47.968689+0000","last_undegraded":"2024-03-18T18:25:47.968689+0000","last_fullsized":"2024-03-18T18:25:47.968689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4262","last_scrub_stamp":"2024-03-18T18:25:47.968474+0000","last_deep_scrub":"56'4262","last_deep_scrub_stamp":"2024-03-18T18:25:47.968474+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.968474+0000","objects_scrubbed":2,"log_size":4262,"log_dups_size":0,"ondisk_log_size":4262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:48.817587+0000","scrub_duration":0.043698319999999999,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"54'3985","reported_seq":3277,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.659172+0000","last_change":"2024-03-18T18:25:29.022937+0000","last_active":"2024-03-18T18:25:40.659172+0000","last_peered":"2024-03-18T18:25:40.659172+0000","last_clean":"2024-03-18T18:25:40.659172+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:25:40.659172+0000","last_undegraded":"2024-03-18T18:25:40.659172+0000","last_fullsized":"2024-03-18T18:25:40.659172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4044","reported_seq":3329,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:52.496669+0000","last_change":"2024-03-18T18:25:52.496847+0000","last_active":"2024-03-18T18:25:52.496669+0000","last_peered":"2024-03-18T18:25:52.496669+0000","last_clean":"2024-03-18T18:25:52.496669+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:52.496669+0000","last_undegraded":"2024-03-18T18:25:52.496669+0000","last_fullsized":"2024-03-18T18:25:52.496669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4044","last_scrub_stamp":"2024-03-18T18:25:52.496642+0000","last_deep_scrub":"56'4044","last_deep_scrub_stamp":"2024-03-18T18:25:52.496642+0000","last_clean_scrub_stamp":"2024-03-18T18:25:52.496642+0000","objects_scrubbed":4,"log_size":4044,"log_dups_size":0,"ondisk_log_size":4044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:01.118815+0000","scrub_duration":0.055416811000000003,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"56'1441","reported_seq":1504,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.225181+0000","last_change":"2024-03-18T18:25:41.225345+0000","last_active":"2024-03-18T18:25:41.225181+0000","last_peered":"2024-03-18T18:25:41.225181+0000","last_clean":"2024-03-18T18:25:41.225181+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:41.225181+0000","last_undegraded":"2024-03-18T18:25:41.225181+0000","last_fullsized":"2024-03-18T18:25:41.225181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1441","last_scrub_stamp":"2024-03-18T18:25:41.225139+0000","last_deep_scrub":"56'1441","last_deep_scrub_stamp":"2024-03-18T18:25:41.225139+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.225139+0000","objects_scrubbed":2,"log_size":1441,"log_dups_size":0,"ondisk_log_size":1441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:00:20.198746+0000","scrub_duration":0.033432481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2984,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819267+0000","last_change":"2024-03-18T18:25:29.062033+0000","last_active":"2024-03-18T18:25:37.819267+0000","last_peered":"2024-03-18T18:25:37.819267+0000","last_clean":"2024-03-18T18:25:37.819267+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:37.819267+0000","last_undegraded":"2024-03-18T18:25:37.819267+0000","last_fullsized":"2024-03-18T18:25:37.819267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"56'3529","reported_seq":3592,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.844515+0000","last_change":"2024-03-18T18:25:43.844735+0000","last_active":"2024-03-18T18:25:43.844515+0000","last_peered":"2024-03-18T18:25:43.844515+0000","last_clean":"2024-03-18T18:25:43.844515+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:43.844515+0000","last_undegraded":"2024-03-18T18:25:43.844515+0000","last_fullsized":"2024-03-18T18:25:43.844515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3529","last_scrub_stamp":"2024-03-18T18:25:43.844458+0000","last_deep_scrub":"56'3529","last_deep_scrub_stamp":"2024-03-18T18:25:43.844458+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.844458+0000","objects_scrubbed":2,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:01:59.288139+0000","scrub_duration":0.048300498999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"56'682","reported_seq":745,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:45.126119+0000","last_change":"2024-03-18T18:25:45.126364+0000","last_active":"2024-03-18T18:25:45.126119+0000","last_peered":"2024-03-18T18:25:45.126119+0000","last_clean":"2024-03-18T18:25:45.126119+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:45.126119+0000","last_undegraded":"2024-03-18T18:25:45.126119+0000","last_fullsized":"2024-03-18T18:25:45.126119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'682","last_scrub_stamp":"2024-03-18T18:25:45.126076+0000","last_deep_scrub":"56'682","last_deep_scrub_stamp":"2024-03-18T18:25:45.126076+0000","last_clean_scrub_stamp":"2024-03-18T18:25:45.126076+0000","objects_scrubbed":3,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:19.202685+0000","scrub_duration":0.033214492999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"54'4461","reported_seq":3636,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.748143+0000","last_change":"2024-03-18T18:25:29.040660+0000","last_active":"2024-03-18T18:25:37.748143+0000","last_peered":"2024-03-18T18:25:37.748143+0000","last_clean":"2024-03-18T18:25:37.748143+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:25:37.748143+0000","last_undegraded":"2024-03-18T18:25:37.748143+0000","last_fullsized":"2024-03-18T18:25:37.748143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4461,"log_dups_size":0,"ondisk_log_size":4461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"56'5550","reported_seq":5613,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.516321+0000","last_change":"2024-03-18T18:25:47.516523+0000","last_active":"2024-03-18T18:25:47.516321+0000","last_peered":"2024-03-18T18:25:47.516321+0000","last_clean":"2024-03-18T18:25:47.516321+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:47.516321+0000","last_undegraded":"2024-03-18T18:25:47.516321+0000","last_fullsized":"2024-03-18T18:25:47.516321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5550","last_scrub_stamp":"2024-03-18T18:25:47.516294+0000","last_deep_scrub":"56'5550","last_deep_scrub_stamp":"2024-03-18T18:25:47.516294+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.516294+0000","objects_scrubbed":4,"log_size":5550,"log_dups_size":0,"ondisk_log_size":5550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:33:26.469138+0000","scrub_duration":0.092072492000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"54'3911","reported_seq":3237,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820491+0000","last_change":"2024-03-18T18:25:29.032708+0000","last_active":"2024-03-18T18:25:37.820491+0000","last_peered":"2024-03-18T18:25:37.820491+0000","last_clean":"2024-03-18T18:25:37.820491+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:25:37.820491+0000","last_undegraded":"2024-03-18T18:25:37.820491+0000","last_fullsized":"2024-03-18T18:25:37.820491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"56'1870","reported_seq":1933,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:45.860812+0000","last_change":"2024-03-18T18:25:45.861089+0000","last_active":"2024-03-18T18:25:45.860812+0000","last_peered":"2024-03-18T18:25:45.860812+0000","last_clean":"2024-03-18T18:25:45.860812+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:45.860812+0000","last_undegraded":"2024-03-18T18:25:45.860812+0000","last_fullsized":"2024-03-18T18:25:45.860812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1870","last_scrub_stamp":"2024-03-18T18:25:45.860770+0000","last_deep_scrub":"56'1870","last_deep_scrub_stamp":"2024-03-18T18:25:45.860770+0000","last_clean_scrub_stamp":"2024-03-18T18:25:45.860770+0000","objects_scrubbed":6,"log_size":1870,"log_dups_size":0,"ondisk_log_size":1870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:25.178558+0000","scrub_duration":0.078756888999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18032374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1972,"num_write_kb":19324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"54'3669","reported_seq":3080,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821500+0000","last_change":"2024-03-18T18:25:29.027139+0000","last_active":"2024-03-18T18:25:37.821500+0000","last_peered":"2024-03-18T18:25:37.821500+0000","last_clean":"2024-03-18T18:25:37.821500+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:25:37.821500+0000","last_undegraded":"2024-03-18T18:25:37.821500+0000","last_fullsized":"2024-03-18T18:25:37.821500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3669,"log_dups_size":0,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"56'2296","reported_seq":2359,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.484053+0000","last_change":"2024-03-18T18:25:41.484347+0000","last_active":"2024-03-18T18:25:41.484053+0000","last_peered":"2024-03-18T18:25:41.484053+0000","last_clean":"2024-03-18T18:25:41.484053+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:41.484053+0000","last_undegraded":"2024-03-18T18:25:41.484053+0000","last_fullsized":"2024-03-18T18:25:41.484053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2296","last_scrub_stamp":"2024-03-18T18:25:41.483991+0000","last_deep_scrub":"56'2296","last_deep_scrub_stamp":"2024-03-18T18:25:41.483991+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.483991+0000","objects_scrubbed":3,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.106164+0000","scrub_duration":0.040176058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1144,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"56'3706","reported_seq":3086,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:52.814233+0000","last_change":"2024-03-18T18:25:52.814394+0000","last_active":"2024-03-18T18:25:52.814233+0000","last_peered":"2024-03-18T18:25:52.814233+0000","last_clean":"2024-03-18T18:25:52.814233+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:52.814233+0000","last_undegraded":"2024-03-18T18:25:52.814233+0000","last_fullsized":"2024-03-18T18:25:52.814233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3706","last_scrub_stamp":"2024-03-18T18:25:52.814198+0000","last_deep_scrub":"56'3706","last_deep_scrub_stamp":"2024-03-18T18:25:52.814198+0000","last_clean_scrub_stamp":"2024-03-18T18:25:52.814198+0000","objects_scrubbed":2,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:59:43.699712+0000","scrub_duration":0.039535882000000001,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"54'2695","reported_seq":2747,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821798+0000","last_change":"2024-03-18T18:09:12.452849+0000","last_active":"2024-03-18T18:25:37.821798+0000","last_peered":"2024-03-18T18:25:37.821798+0000","last_clean":"2024-03-18T18:25:37.821798+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:25:37.821798+0000","last_undegraded":"2024-03-18T18:25:37.821798+0000","last_fullsized":"2024-03-18T18:25:37.821798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":2695,"log_dups_size":0,"ondisk_log_size":2695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'3879","reported_seq":3253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:50.521236+0000","last_change":"2024-03-18T18:25:50.521386+0000","last_active":"2024-03-18T18:25:50.521236+0000","last_peered":"2024-03-18T18:25:50.521236+0000","last_clean":"2024-03-18T18:25:50.521236+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:50.521236+0000","last_undegraded":"2024-03-18T18:25:50.521236+0000","last_fullsized":"2024-03-18T18:25:50.521236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3879","last_scrub_stamp":"2024-03-18T18:25:50.521213+0000","last_deep_scrub":"56'3879","last_deep_scrub_stamp":"2024-03-18T18:25:50.521213+0000","last_clean_scrub_stamp":"2024-03-18T18:25:50.521213+0000","objects_scrubbed":3,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:25.096813+0000","scrub_duration":0.051826733,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"56'3875","reported_seq":3939,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.986624+0000","last_change":"2024-03-18T18:25:59.986799+0000","last_active":"2024-03-18T18:25:59.986624+0000","last_peered":"2024-03-18T18:25:59.986624+0000","last_clean":"2024-03-18T18:25:59.986624+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:59.986624+0000","last_undegraded":"2024-03-18T18:25:59.986624+0000","last_fullsized":"2024-03-18T18:25:59.986624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3875","last_scrub_stamp":"2024-03-18T18:25:59.986592+0000","last_deep_scrub":"56'3875","last_deep_scrub_stamp":"2024-03-18T18:25:59.986592+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.986592+0000","objects_scrubbed":6,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:24:59.170445+0000","scrub_duration":0.058570773999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3979,"num_write_kb":30875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"54'3911","reported_seq":3211,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751646+0000","last_change":"2024-03-18T18:25:29.054617+0000","last_active":"2024-03-18T18:25:37.751646+0000","last_peered":"2024-03-18T18:25:37.751646+0000","last_clean":"2024-03-18T18:25:37.751646+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:25:37.751646+0000","last_undegraded":"2024-03-18T18:25:37.751646+0000","last_fullsized":"2024-03-18T18:25:37.751646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"56'2798","reported_seq":2862,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:42.717588+0000","last_change":"2024-03-18T18:25:42.717894+0000","last_active":"2024-03-18T18:25:42.717588+0000","last_peered":"2024-03-18T18:25:42.717588+0000","last_clean":"2024-03-18T18:25:42.717588+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:42.717588+0000","last_undegraded":"2024-03-18T18:25:42.717588+0000","last_fullsized":"2024-03-18T18:25:42.717588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2798","last_scrub_stamp":"2024-03-18T18:25:42.717503+0000","last_deep_scrub":"56'2798","last_deep_scrub_stamp":"2024-03-18T18:25:42.717503+0000","last_clean_scrub_stamp":"2024-03-18T18:25:42.717503+0000","objects_scrubbed":4,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:35:36.581172+0000","scrub_duration":0.050648071000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5500,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"56'3873","reported_seq":3198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:49.807272+0000","last_change":"2024-03-18T18:25:49.807385+0000","last_active":"2024-03-18T18:25:49.807272+0000","last_peered":"2024-03-18T18:25:49.807272+0000","last_clean":"2024-03-18T18:25:49.807272+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:49.807272+0000","last_undegraded":"2024-03-18T18:25:49.807272+0000","last_fullsized":"2024-03-18T18:25:49.807272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3873","last_scrub_stamp":"2024-03-18T18:25:49.807250+0000","last_deep_scrub":"56'3873","last_deep_scrub_stamp":"2024-03-18T18:25:49.807250+0000","last_clean_scrub_stamp":"2024-03-18T18:25:49.807250+0000","objects_scrubbed":3,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:08:26.538859+0000","scrub_duration":0.047405282999999999,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"54'148","reported_seq":201,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820802+0000","last_change":"2024-03-18T18:09:12.452129+0000","last_active":"2024-03-18T18:25:37.820802+0000","last_peered":"2024-03-18T18:25:37.820802+0000","last_clean":"2024-03-18T18:25:37.820802+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:25:37.820802+0000","last_undegraded":"2024-03-18T18:25:37.820802+0000","last_fullsized":"2024-03-18T18:25:37.820802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3409,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751834+0000","last_change":"2024-03-18T18:25:29.053722+0000","last_active":"2024-03-18T18:25:37.751834+0000","last_peered":"2024-03-18T18:25:37.751834+0000","last_clean":"2024-03-18T18:25:37.751834+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:25:37.751834+0000","last_undegraded":"2024-03-18T18:25:37.751834+0000","last_fullsized":"2024-03-18T18:25:37.751834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"56'1129","reported_seq":1193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:44.808254+0000","last_change":"2024-03-18T18:25:44.808524+0000","last_active":"2024-03-18T18:25:44.808254+0000","last_peered":"2024-03-18T18:25:44.808254+0000","last_clean":"2024-03-18T18:25:44.808254+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:44.808254+0000","last_undegraded":"2024-03-18T18:25:44.808254+0000","last_fullsized":"2024-03-18T18:25:44.808254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1129","last_scrub_stamp":"2024-03-18T18:25:44.808198+0000","last_deep_scrub":"56'1129","last_deep_scrub_stamp":"2024-03-18T18:25:44.808198+0000","last_clean_scrub_stamp":"2024-03-18T18:25:44.808198+0000","objects_scrubbed":2,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:59.462515+0000","scrub_duration":0.037470452000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"54'3649","reported_seq":2975,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756778+0000","last_change":"2024-03-18T18:25:29.016810+0000","last_active":"2024-03-18T18:25:37.756778+0000","last_peered":"2024-03-18T18:25:37.756778+0000","last_clean":"2024-03-18T18:25:37.756778+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:25:37.756778+0000","last_undegraded":"2024-03-18T18:25:37.756778+0000","last_fullsized":"2024-03-18T18:25:37.756778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3649,"log_dups_size":0,"ondisk_log_size":3649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"56'1557","reported_seq":1621,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.009218+0000","last_change":"2024-03-18T18:25:40.009370+0000","last_active":"2024-03-18T18:25:40.009218+0000","last_peered":"2024-03-18T18:25:40.009218+0000","last_clean":"2024-03-18T18:25:40.009218+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:40.009218+0000","last_undegraded":"2024-03-18T18:25:40.009218+0000","last_fullsized":"2024-03-18T18:25:40.009218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1557","last_scrub_stamp":"2024-03-18T18:25:40.009192+0000","last_deep_scrub":"56'1557","last_deep_scrub_stamp":"2024-03-18T18:25:40.009192+0000","last_clean_scrub_stamp":"2024-03-18T18:25:40.009192+0000","objects_scrubbed":6,"log_size":1557,"log_dups_size":0,"ondisk_log_size":1557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:16.766526+0000","scrub_duration":0.020714032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"54'4133","reported_seq":3370,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750837+0000","last_change":"2024-03-18T18:25:29.051925+0000","last_active":"2024-03-18T18:25:37.750837+0000","last_peered":"2024-03-18T18:25:37.750837+0000","last_clean":"2024-03-18T18:25:37.750837+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:25:37.750837+0000","last_undegraded":"2024-03-18T18:25:37.750837+0000","last_fullsized":"2024-03-18T18:25:37.750837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4133,"log_dups_size":0,"ondisk_log_size":4133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"56'1390","reported_seq":1454,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.490628+0000","last_change":"2024-03-18T18:25:43.490805+0000","last_active":"2024-03-18T18:25:43.490628+0000","last_peered":"2024-03-18T18:25:43.490628+0000","last_clean":"2024-03-18T18:25:43.490628+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:43.490628+0000","last_undegraded":"2024-03-18T18:25:43.490628+0000","last_fullsized":"2024-03-18T18:25:43.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1390","last_scrub_stamp":"2024-03-18T18:25:43.490608+0000","last_deep_scrub":"56'1390","last_deep_scrub_stamp":"2024-03-18T18:25:43.490608+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.490608+0000","objects_scrubbed":2,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:38.146924+0000","scrub_duration":0.044349553999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"56'3702","reported_seq":3058,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.208364+0000","last_change":"2024-03-18T18:25:41.208536+0000","last_active":"2024-03-18T18:25:41.208364+0000","last_peered":"2024-03-18T18:25:41.208364+0000","last_clean":"2024-03-18T18:25:41.208364+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:41.208364+0000","last_undegraded":"2024-03-18T18:25:41.208364+0000","last_fullsized":"2024-03-18T18:25:41.208364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3702","last_scrub_stamp":"2024-03-18T18:25:41.208326+0000","last_deep_scrub":"56'3702","last_deep_scrub_stamp":"2024-03-18T18:25:41.208326+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.208326+0000","objects_scrubbed":2,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:42.057439+0000","scrub_duration":0.048613747999999998,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"56'1378","reported_seq":1442,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.908708+0000","last_change":"2024-03-18T18:25:43.908832+0000","last_active":"2024-03-18T18:25:43.908708+0000","last_peered":"2024-03-18T18:25:43.908708+0000","last_clean":"2024-03-18T18:25:43.908708+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:43.908708+0000","last_undegraded":"2024-03-18T18:25:43.908708+0000","last_fullsized":"2024-03-18T18:25:43.908708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1378","last_scrub_stamp":"2024-03-18T18:25:43.908685+0000","last_deep_scrub":"56'1378","last_deep_scrub_stamp":"2024-03-18T18:25:43.908685+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.908685+0000","objects_scrubbed":1,"log_size":1378,"log_dups_size":0,"ondisk_log_size":1378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:52.530858+0000","scrub_duration":0.016835227000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"54'4065","reported_seq":3355,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:38.707390+0000","last_change":"2024-03-18T18:25:29.226986+0000","last_active":"2024-03-18T18:25:38.707390+0000","last_peered":"2024-03-18T18:25:38.707390+0000","last_clean":"2024-03-18T18:25:38.707390+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:25:38.707390+0000","last_undegraded":"2024-03-18T18:25:38.707390+0000","last_fullsized":"2024-03-18T18:25:38.707390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4065,"log_dups_size":0,"ondisk_log_size":4065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"56'4631","reported_seq":4695,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:57.002010+0000","last_change":"2024-03-18T18:25:57.002379+0000","last_active":"2024-03-18T18:25:57.002010+0000","last_peered":"2024-03-18T18:25:57.002010+0000","last_clean":"2024-03-18T18:25:57.002010+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:57.002010+0000","last_undegraded":"2024-03-18T18:25:57.002010+0000","last_fullsized":"2024-03-18T18:25:57.002010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4631","last_scrub_stamp":"2024-03-18T18:25:57.001949+0000","last_deep_scrub":"56'4631","last_deep_scrub_stamp":"2024-03-18T18:25:57.001949+0000","last_clean_scrub_stamp":"2024-03-18T18:25:57.001949+0000","objects_scrubbed":2,"log_size":4631,"log_dups_size":0,"ondisk_log_size":4631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:31.223814+0000","scrub_duration":0.049250552000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3739","reported_seq":3064,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821037+0000","last_change":"2024-03-18T18:25:29.033548+0000","last_active":"2024-03-18T18:25:37.821037+0000","last_peered":"2024-03-18T18:25:37.821037+0000","last_clean":"2024-03-18T18:25:37.821037+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:25:37.821037+0000","last_undegraded":"2024-03-18T18:25:37.821037+0000","last_fullsized":"2024-03-18T18:25:37.821037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"56'5041","reported_seq":5105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.017168+0000","last_change":"2024-03-18T18:25:46.017304+0000","last_active":"2024-03-18T18:25:46.017168+0000","last_peered":"2024-03-18T18:25:46.017168+0000","last_clean":"2024-03-18T18:25:46.017168+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:46.017168+0000","last_undegraded":"2024-03-18T18:25:46.017168+0000","last_fullsized":"2024-03-18T18:25:46.017168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5041","last_scrub_stamp":"2024-03-18T18:25:46.017144+0000","last_deep_scrub":"56'5041","last_deep_scrub_stamp":"2024-03-18T18:25:46.017144+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.017144+0000","objects_scrubbed":7,"log_size":5041,"log_dups_size":0,"ondisk_log_size":5041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:02:01.460825+0000","scrub_duration":0.095345580999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'3518","reported_seq":2899,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751291+0000","last_change":"2024-03-18T18:25:29.055382+0000","last_active":"2024-03-18T18:25:37.751291+0000","last_peered":"2024-03-18T18:25:37.751291+0000","last_clean":"2024-03-18T18:25:37.751291+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:25:37.751291+0000","last_undegraded":"2024-03-18T18:25:37.751291+0000","last_fullsized":"2024-03-18T18:25:37.751291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3518,"log_dups_size":0,"ondisk_log_size":3518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"56'119","reported_seq":220,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:56.012960+0000","last_change":"2024-03-18T18:25:56.013101+0000","last_active":"2024-03-18T18:25:56.012960+0000","last_peered":"2024-03-18T18:25:56.012960+0000","last_clean":"2024-03-18T18:25:56.012960+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:56.012960+0000","last_undegraded":"2024-03-18T18:25:56.012960+0000","last_fullsized":"2024-03-18T18:25:56.012960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-03-18T18:25:56.012932+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-03-18T18:25:56.012932+0000","last_clean_scrub_stamp":"2024-03-18T18:25:56.012932+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:03.154114+0000","scrub_duration":0.016100778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"56'1923","reported_seq":1988,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.496148+0000","last_change":"2024-03-18T18:25:46.496148+0000","last_active":"2024-03-18T18:25:46.496148+0000","last_peered":"2024-03-18T18:25:46.496148+0000","last_clean":"2024-03-18T18:25:46.496148+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:46.496148+0000","last_undegraded":"2024-03-18T18:25:46.496148+0000","last_fullsized":"2024-03-18T18:25:46.496148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1923","last_scrub_stamp":"2024-03-18T18:25:46.495988+0000","last_deep_scrub":"56'1923","last_deep_scrub_stamp":"2024-03-18T18:25:46.495988+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.495988+0000","objects_scrubbed":3,"log_size":1923,"log_dups_size":0,"ondisk_log_size":1923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:01.150305+0000","scrub_duration":0.039538838999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:55.069417+0000","last_change":"2024-03-18T18:25:55.069555+0000","last_active":"2024-03-18T18:25:55.069417+0000","last_peered":"2024-03-18T18:25:55.069417+0000","last_clean":"2024-03-18T18:25:55.069417+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:55.069417+0000","last_undegraded":"2024-03-18T18:25:55.069417+0000","last_fullsized":"2024-03-18T18:25:55.069417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3732","last_scrub_stamp":"2024-03-18T18:25:55.069397+0000","last_deep_scrub":"54'3732","last_deep_scrub_stamp":"2024-03-18T18:25:55.069397+0000","last_clean_scrub_stamp":"2024-03-18T18:25:55.069397+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:59:45.954910+0000","scrub_duration":0.034961982000000003,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"56'4978","reported_seq":5043,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.167805+0000","last_change":"2024-03-18T18:25:59.167976+0000","last_active":"2024-03-18T18:25:59.167805+0000","last_peered":"2024-03-18T18:25:59.167805+0000","last_clean":"2024-03-18T18:25:59.167805+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:59.167805+0000","last_undegraded":"2024-03-18T18:25:59.167805+0000","last_fullsized":"2024-03-18T18:25:59.167805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4978","last_scrub_stamp":"2024-03-18T18:25:59.167781+0000","last_deep_scrub":"56'4978","last_deep_scrub_stamp":"2024-03-18T18:25:59.167781+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.167781+0000","objects_scrubbed":3,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:33.389646+0000","scrub_duration":0.048284953999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2947,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.766358+0000","last_change":"2024-03-18T18:25:54.766577+0000","last_active":"2024-03-18T18:25:54.766358+0000","last_peered":"2024-03-18T18:25:54.766358+0000","last_clean":"2024-03-18T18:25:54.766358+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:54.766358+0000","last_undegraded":"2024-03-18T18:25:54.766358+0000","last_fullsized":"2024-03-18T18:25:54.766358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3549","last_scrub_stamp":"2024-03-18T18:25:54.766331+0000","last_deep_scrub":"54'3549","last_deep_scrub_stamp":"2024-03-18T18:25:54.766331+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.766331+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:13.460331+0000","scrub_duration":0.038148003999999999,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"56'2670","reported_seq":3275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.951311+0000","last_change":"2024-03-18T18:25:41.951311+0000","last_active":"2024-03-18T18:25:41.951311+0000","last_peered":"2024-03-18T18:25:41.951311+0000","last_clean":"2024-03-18T18:25:41.951311+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:41.951311+0000","last_undegraded":"2024-03-18T18:25:41.951311+0000","last_fullsized":"2024-03-18T18:25:41.951311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2670","last_scrub_stamp":"2024-03-18T18:25:41.950936+0000","last_deep_scrub":"56'2670","last_deep_scrub_stamp":"2024-03-18T18:25:41.950936+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.950936+0000","objects_scrubbed":2,"log_size":2670,"log_dups_size":0,"ondisk_log_size":2670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:16.526536+0000","scrub_duration":0.038474542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"54'4235","reported_seq":3485,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.822701+0000","last_change":"2024-03-18T18:25:29.032416+0000","last_active":"2024-03-18T18:25:37.822701+0000","last_peered":"2024-03-18T18:25:37.822701+0000","last_clean":"2024-03-18T18:25:37.822701+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:25:37.822701+0000","last_undegraded":"2024-03-18T18:25:37.822701+0000","last_fullsized":"2024-03-18T18:25:37.822701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4235,"log_dups_size":0,"ondisk_log_size":4235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"56'5926","reported_seq":5991,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:48.541126+0000","last_change":"2024-03-18T18:25:48.541126+0000","last_active":"2024-03-18T18:25:48.541126+0000","last_peered":"2024-03-18T18:25:48.541126+0000","last_clean":"2024-03-18T18:25:48.541126+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:48.541126+0000","last_undegraded":"2024-03-18T18:25:48.541126+0000","last_fullsized":"2024-03-18T18:25:48.541126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5926","last_scrub_stamp":"2024-03-18T18:25:48.540811+0000","last_deep_scrub":"56'5926","last_deep_scrub_stamp":"2024-03-18T18:25:48.540811+0000","last_clean_scrub_stamp":"2024-03-18T18:25:48.540811+0000","objects_scrubbed":6,"log_size":5926,"log_dups_size":0,"ondisk_log_size":5926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:28:42.884022+0000","scrub_duration":0.085163540999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3976","reported_seq":3265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.457689+0000","last_change":"2024-03-18T18:25:54.457689+0000","last_active":"2024-03-18T18:25:54.457689+0000","last_peered":"2024-03-18T18:25:54.457689+0000","last_clean":"2024-03-18T18:25:54.457689+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:54.457689+0000","last_undegraded":"2024-03-18T18:25:54.457689+0000","last_fullsized":"2024-03-18T18:25:54.457689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3976","last_scrub_stamp":"2024-03-18T18:25:54.457559+0000","last_deep_scrub":"54'3976","last_deep_scrub_stamp":"2024-03-18T18:25:54.457559+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.457559+0000","objects_scrubbed":0,"log_size":3976,"log_dups_size":0,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:02:09.901240+0000","scrub_duration":0.040947814999999999,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"56'956","reported_seq":1021,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.069999+0000","last_change":"2024-03-18T18:25:41.069999+0000","last_active":"2024-03-18T18:25:41.069999+0000","last_peered":"2024-03-18T18:25:41.069999+0000","last_clean":"2024-03-18T18:25:41.069999+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:41.069999+0000","last_undegraded":"2024-03-18T18:25:41.069999+0000","last_fullsized":"2024-03-18T18:25:41.069999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'956","last_scrub_stamp":"2024-03-18T18:25:41.069763+0000","last_deep_scrub":"56'956","last_deep_scrub_stamp":"2024-03-18T18:25:41.069763+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.069763+0000","objects_scrubbed":3,"log_size":956,"log_dups_size":0,"ondisk_log_size":956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:28:35.412974+0000","scrub_duration":0.031375185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"54'3615","reported_seq":3011,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.179980+0000","last_change":"2024-03-18T18:25:29.037811+0000","last_active":"2024-03-18T18:25:40.179980+0000","last_peered":"2024-03-18T18:25:40.179980+0000","last_clean":"2024-03-18T18:25:40.179980+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:25:40.179980+0000","last_undegraded":"2024-03-18T18:25:40.179980+0000","last_fullsized":"2024-03-18T18:25:40.179980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"48'3704","reported_seq":3758,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.145560+0000","last_change":"2024-03-18T18:09:12.451134+0000","last_active":"2024-03-18T18:25:41.145560+0000","last_peered":"2024-03-18T18:25:41.145560+0000","last_clean":"2024-03-18T18:25:41.145560+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:25:41.145560+0000","last_undegraded":"2024-03-18T18:25:41.145560+0000","last_fullsized":"2024-03-18T18:25:41.145560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:38.208770+0000","last_change":"2024-03-18T18:25:29.039953+0000","last_active":"2024-03-18T18:25:38.208770+0000","last_peered":"2024-03-18T18:25:38.208770+0000","last_clean":"2024-03-18T18:25:38.208770+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:25:38.208770+0000","last_undegraded":"2024-03-18T18:25:38.208770+0000","last_fullsized":"2024-03-18T18:25:38.208770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"56'2149","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.106012+0000","last_change":"2024-03-18T18:25:54.106218+0000","last_active":"2024-03-18T18:25:54.106012+0000","last_peered":"2024-03-18T18:25:54.106012+0000","last_clean":"2024-03-18T18:25:54.106012+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:54.106012+0000","last_undegraded":"2024-03-18T18:25:54.106012+0000","last_fullsized":"2024-03-18T18:25:54.106012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2149","last_scrub_stamp":"2024-03-18T18:25:54.105980+0000","last_deep_scrub":"56'2149","last_deep_scrub_stamp":"2024-03-18T18:25:54.105980+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.105980+0000","objects_scrubbed":5,"log_size":2149,"log_dups_size":0,"ondisk_log_size":2149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:01.247163+0000","scrub_duration":0.135641664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2815,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750018+0000","last_change":"2024-03-18T18:25:29.044961+0000","last_active":"2024-03-18T18:25:37.750018+0000","last_peered":"2024-03-18T18:25:37.750018+0000","last_clean":"2024-03-18T18:25:37.750018+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:25:37.750018+0000","last_undegraded":"2024-03-18T18:25:37.750018+0000","last_fullsized":"2024-03-18T18:25:37.750018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"56'1822","reported_seq":1886,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.832517+0000","last_change":"2024-03-18T18:25:41.832792+0000","last_active":"2024-03-18T18:25:41.832517+0000","last_peered":"2024-03-18T18:25:41.832517+0000","last_clean":"2024-03-18T18:25:41.832517+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:41.832517+0000","last_undegraded":"2024-03-18T18:25:41.832517+0000","last_fullsized":"2024-03-18T18:25:41.832517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1822","last_scrub_stamp":"2024-03-18T18:25:41.832464+0000","last_deep_scrub":"56'1822","last_deep_scrub_stamp":"2024-03-18T18:25:41.832464+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.832464+0000","objects_scrubbed":2,"log_size":1822,"log_dups_size":0,"ondisk_log_size":1822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.454637+0000","scrub_duration":0.030830237999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"56'3545","reported_seq":2962,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:50.806420+0000","last_change":"2024-03-18T18:25:50.806580+0000","last_active":"2024-03-18T18:25:50.806420+0000","last_peered":"2024-03-18T18:25:50.806420+0000","last_clean":"2024-03-18T18:25:50.806420+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:50.806420+0000","last_undegraded":"2024-03-18T18:25:50.806420+0000","last_fullsized":"2024-03-18T18:25:50.806420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3545","last_scrub_stamp":"2024-03-18T18:25:50.806396+0000","last_deep_scrub":"56'3545","last_deep_scrub_stamp":"2024-03-18T18:25:50.806396+0000","last_clean_scrub_stamp":"2024-03-18T18:25:50.806396+0000","objects_scrubbed":5,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:11.869852+0000","scrub_duration":0.050638803000000003,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"48'1602","reported_seq":1655,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750592+0000","last_change":"2024-03-18T18:09:12.450128+0000","last_active":"2024-03-18T18:25:37.750592+0000","last_peered":"2024-03-18T18:25:37.750592+0000","last_clean":"2024-03-18T18:25:37.750592+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:25:37.750592+0000","last_undegraded":"2024-03-18T18:25:37.750592+0000","last_fullsized":"2024-03-18T18:25:37.750592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1602,"log_dups_size":0,"ondisk_log_size":1602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"56'3744","reported_seq":3051,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:49.482455+0000","last_change":"2024-03-18T18:25:49.482819+0000","last_active":"2024-03-18T18:25:49.482455+0000","last_peered":"2024-03-18T18:25:49.482455+0000","last_clean":"2024-03-18T18:25:49.482455+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:49.482455+0000","last_undegraded":"2024-03-18T18:25:49.482455+0000","last_fullsized":"2024-03-18T18:25:49.482455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3744","last_scrub_stamp":"2024-03-18T18:25:49.482375+0000","last_deep_scrub":"56'3744","last_deep_scrub_stamp":"2024-03-18T18:25:49.482375+0000","last_clean_scrub_stamp":"2024-03-18T18:25:49.482375+0000","objects_scrubbed":1,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:26.239708+0000","scrub_duration":0.047960088999999997,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'2480","reported_seq":2544,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.116348+0000","last_change":"2024-03-18T18:25:40.116493+0000","last_active":"2024-03-18T18:25:40.116348+0000","last_peered":"2024-03-18T18:25:40.116348+0000","last_clean":"2024-03-18T18:25:40.116348+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:40.116348+0000","last_undegraded":"2024-03-18T18:25:40.116348+0000","last_fullsized":"2024-03-18T18:25:40.116348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2480","last_scrub_stamp":"2024-03-18T18:25:40.116301+0000","last_deep_scrub":"56'2480","last_deep_scrub_stamp":"2024-03-18T18:25:40.116301+0000","last_clean_scrub_stamp":"2024-03-18T18:25:40.116301+0000","objects_scrubbed":2,"log_size":2480,"log_dups_size":0,"ondisk_log_size":2480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:33:19.069144+0000","scrub_duration":0.043506561999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"56'4000","reported_seq":3341,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:51.142475+0000","last_change":"2024-03-18T18:25:51.142616+0000","last_active":"2024-03-18T18:25:51.142475+0000","last_peered":"2024-03-18T18:25:51.142475+0000","last_clean":"2024-03-18T18:25:51.142475+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:51.142475+0000","last_undegraded":"2024-03-18T18:25:51.142475+0000","last_fullsized":"2024-03-18T18:25:51.142475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4000","last_scrub_stamp":"2024-03-18T18:25:51.142454+0000","last_deep_scrub":"56'4000","last_deep_scrub_stamp":"2024-03-18T18:25:51.142454+0000","last_clean_scrub_stamp":"2024-03-18T18:25:51.142454+0000","objects_scrubbed":7,"log_size":4000,"log_dups_size":0,"ondisk_log_size":4000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:08:27.874062+0000","scrub_duration":0.071429648999999998,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"56'2625","reported_seq":2689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:39.120325+0000","last_change":"2024-03-18T18:25:39.120490+0000","last_active":"2024-03-18T18:25:39.120325+0000","last_peered":"2024-03-18T18:25:39.120325+0000","last_clean":"2024-03-18T18:25:39.120325+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:39.120325+0000","last_undegraded":"2024-03-18T18:25:39.120325+0000","last_fullsized":"2024-03-18T18:25:39.120325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2625","last_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_deep_scrub":"56'2625","last_deep_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_clean_scrub_stamp":"2024-03-18T18:25:39.120285+0000","objects_scrubbed":3,"log_size":2625,"log_dups_size":0,"ondisk_log_size":2625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:53.774603+0000","scrub_duration":0.046006920999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"54'3488","reported_seq":2913,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749109+0000","last_change":"2024-03-18T18:25:29.044854+0000","last_active":"2024-03-18T18:25:37.749109+0000","last_peered":"2024-03-18T18:25:37.749109+0000","last_clean":"2024-03-18T18:25:37.749109+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:25:37.749109+0000","last_undegraded":"2024-03-18T18:25:37.749109+0000","last_fullsized":"2024-03-18T18:25:37.749109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"54'4483","reported_seq":4536,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752243+0000","last_change":"2024-03-18T18:09:12.450867+0000","last_active":"2024-03-18T18:25:37.752243+0000","last_peered":"2024-03-18T18:25:37.752243+0000","last_clean":"2024-03-18T18:25:37.752243+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:25:37.752243+0000","last_undegraded":"2024-03-18T18:25:37.752243+0000","last_fullsized":"2024-03-18T18:25:37.752243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"54'3776","reported_seq":3136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.756220+0000","last_change":"2024-03-18T18:25:29.014675+0000","last_active":"2024-03-18T18:25:37.756220+0000","last_peered":"2024-03-18T18:25:37.756220+0000","last_clean":"2024-03-18T18:25:37.756220+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:25:37.756220+0000","last_undegraded":"2024-03-18T18:25:37.756220+0000","last_fullsized":"2024-03-18T18:25:37.756220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"54'3710","reported_seq":3122,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.819720+0000","last_change":"2024-03-18T18:25:29.035433+0000","last_active":"2024-03-18T18:25:37.819720+0000","last_peered":"2024-03-18T18:25:37.819720+0000","last_clean":"2024-03-18T18:25:37.819720+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:25:37.819720+0000","last_undegraded":"2024-03-18T18:25:37.819720+0000","last_fullsized":"2024-03-18T18:25:37.819720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"51'1387","reported_seq":1439,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750859+0000","last_change":"2024-03-18T18:09:12.455077+0000","last_active":"2024-03-18T18:25:37.750859+0000","last_peered":"2024-03-18T18:25:37.750859+0000","last_clean":"2024-03-18T18:25:37.750859+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:25:37.750859+0000","last_undegraded":"2024-03-18T18:25:37.750859+0000","last_fullsized":"2024-03-18T18:25:37.750859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4103","reported_seq":3381,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821222+0000","last_change":"2024-03-18T18:25:29.032671+0000","last_active":"2024-03-18T18:25:37.821222+0000","last_peered":"2024-03-18T18:25:37.821222+0000","last_clean":"2024-03-18T18:25:37.821222+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:25:37.821222+0000","last_undegraded":"2024-03-18T18:25:37.821222+0000","last_fullsized":"2024-03-18T18:25:37.821222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"54'3530","reported_seq":3582,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751989+0000","last_change":"2024-03-18T18:09:12.452815+0000","last_active":"2024-03-18T18:25:37.751989+0000","last_peered":"2024-03-18T18:25:37.751989+0000","last_clean":"2024-03-18T18:25:37.751989+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:25:37.751989+0000","last_undegraded":"2024-03-18T18:25:37.751989+0000","last_fullsized":"2024-03-18T18:25:37.751989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:11.405580+0000","last_clean_scrub_stamp":"2024-03-18T18:09:11.405580+0000","objects_scrubbed":0,"log_size":3530,"log_dups_size":0,"ondisk_log_size":3530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"54'3441","reported_seq":2896,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821781+0000","last_change":"2024-03-18T18:25:29.053757+0000","last_active":"2024-03-18T18:25:37.821781+0000","last_peered":"2024-03-18T18:25:37.821781+0000","last_clean":"2024-03-18T18:25:37.821781+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:25:37.821781+0000","last_undegraded":"2024-03-18T18:25:37.821781+0000","last_fullsized":"2024-03-18T18:25:37.821781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"56'3383","reported_seq":3448,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.104229+0000","last_change":"2024-03-18T18:25:47.104361+0000","last_active":"2024-03-18T18:25:47.104229+0000","last_peered":"2024-03-18T18:25:47.104229+0000","last_clean":"2024-03-18T18:25:47.104229+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:47.104229+0000","last_undegraded":"2024-03-18T18:25:47.104229+0000","last_fullsized":"2024-03-18T18:25:47.104229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3383","last_scrub_stamp":"2024-03-18T18:25:47.104205+0000","last_deep_scrub":"56'3383","last_deep_scrub_stamp":"2024-03-18T18:25:47.104205+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.104205+0000","objects_scrubbed":1,"log_size":3383,"log_dups_size":0,"ondisk_log_size":3383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:22.274913+0000","scrub_duration":0.034214560999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"54'3368","reported_seq":2788,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749232+0000","last_change":"2024-03-18T18:25:29.047446+0000","last_active":"2024-03-18T18:25:37.749232+0000","last_peered":"2024-03-18T18:25:37.749232+0000","last_clean":"2024-03-18T18:25:37.749232+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:25:37.749232+0000","last_undegraded":"2024-03-18T18:25:37.749232+0000","last_fullsized":"2024-03-18T18:25:37.749232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3368,"log_dups_size":0,"ondisk_log_size":3368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"56'1531","reported_seq":1596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.745557+0000","last_change":"2024-03-18T18:25:43.745557+0000","last_active":"2024-03-18T18:25:43.745557+0000","last_peered":"2024-03-18T18:25:43.745557+0000","last_clean":"2024-03-18T18:25:43.745557+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:43.745557+0000","last_undegraded":"2024-03-18T18:25:43.745557+0000","last_fullsized":"2024-03-18T18:25:43.745557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1531","last_scrub_stamp":"2024-03-18T18:25:43.745375+0000","last_deep_scrub":"56'1531","last_deep_scrub_stamp":"2024-03-18T18:25:43.745375+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.745375+0000","objects_scrubbed":3,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:14:39.035373+0000","scrub_duration":0.036436525999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25222,"num_omap_keys":49,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":75039,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241980,"ondisk_log_size":241980,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264990062,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88599,"num_write_kb":695434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34441,"num_omap_keys":67,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":530046976,"data_stored":529980124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85159,"ondisk_log_size":85159,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404728,"kb_used_data":66800,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967112,"statfs":{"total":96636764160,"available":96222322688,"internally_reserved":0,"allocated":68403200,"data_stored":68027641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.78800000000000003,"15min":0.73199999999999998},"min":{"1min":0.35599999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":13.092000000000001,"5min":13.092000000000001,"15min":13.092000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.087,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.3760000000000003,"5min":6.3760000000000003,"15min":6.3760000000000003},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.206,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.73999999999999999,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.5009999999999999},"last":0.78200000000000003}]},{"osd":2,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69199999999999995,"15min":0.749},"min":{"1min":0.38900000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0880000000000001,"5min":1.115,"15min":1.3700000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1579999999999999,"5min":1.655,"15min":5.452},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79700000000000004,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.82799999999999996,"15min":0.90000000000000002},"min":{"1min":0.44800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":2.5859999999999999},"last":1.095}]},{"osd":4,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71599999999999997,"15min":0.76100000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.296,"5min":1.726,"15min":1.726},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":2.085,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":1.121}]},{"osd":5,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.78000000000000003,"15min":0.89100000000000001},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":4.1150000000000002},"last":1.173},{"interface":"front","average":{"1min":1.153,"5min":0.89700000000000002,"15min":0.95299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.968,"5min":1.968,"15min":4.2350000000000003},"last":1.0600000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":1.444,"5min":3.024,"15min":4.1840000000000002},"last":1.145},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.86799999999999999,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.476,"5min":3.1709999999999998,"15min":5.431},"last":1.2030000000000001}]}]},{"osd":6,"up_from":16,"seq":68719476944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367552,"kb_used_data":79736,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94004288,"statfs":{"total":96636764160,"available":96260390912,"internally_reserved":0,"allocated":81649664,"data_stored":81283602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.76200000000000001},"min":{"1min":0.28899999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1060000000000001,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91800000000000004,"15min":0.84099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.224,"5min":10.127000000000001,"15min":10.127000000000001},"last":0.93200000000000005}]},{"osd":1,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95099999999999996,"15min":0.81999999999999995},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":12.565,"15min":12.565},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.087,"15min":0.88300000000000001},"min":{"1min":0.42199999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":16.579999999999998,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.76400000000000001},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.6859999999999999,"5min":6.202,"15min":6.202},"last":0.623},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.157,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.98799999999999999,"15min":0.90200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.1320000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.113,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.68899999999999995}]},{"osd":4,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.33500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.208,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.45000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.726,"5min":10.08,"15min":10.08},"last":1.002}]},{"osd":5,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.83199999999999996,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":27.231000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.054,"15min":1.113},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.351,"5min":9.2509999999999994,"15min":27.478999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.56999999999999995,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4570000000000001,"5min":10.182,"15min":10.182},"last":1.359},{"interface":"front","average":{"1min":1.02,"5min":0.86099999999999999,"15min":0.95499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.474,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.425}]}]},{"osd":5,"up_from":16,"seq":68719476944,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514432,"kb_used_data":104312,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93857408,"statfs":{"total":96636764160,"available":96109985792,"internally_reserved":0,"allocated":106815488,"data_stored":106436602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":2.073,"5min":2.073,"15min":3.6739999999999999},"last":1.117},{"interface":"front","average":{"1min":1.7150000000000001,"5min":0.874,"15min":0.80800000000000005},"min":{"1min":0.57399999999999995,"5min":0.255,"15min":0.255},"max":{"1min":20.013000000000002,"5min":20.013000000000002,"15min":20.013000000000002},"last":0.81299999999999994}]},{"osd":1,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":7.2469999999999999,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.3160000000000001,"5min":0.85799999999999998,"15min":0.83199999999999996},"min":{"1min":0.48199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.231,"5min":10.231,"15min":10.231},"last":0.872}]},{"osd":2,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":0.876,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.041,"5min":12.041,"15min":12.041},"last":1.204},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.317,"15min":0.317},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":1.256}]},{"osd":3,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":0.999,"15min":0.92600000000000005},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":16.183,"5min":16.183,"15min":16.183},"last":0.995},{"interface":"front","average":{"1min":1.125,"5min":0.89000000000000001,"15min":0.97199999999999998},"min":{"1min":0.61799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":13.678000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.71499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.089},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.85799999999999998,"15min":0.90300000000000002},"min":{"1min":0.74399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":1.159}]},{"osd":6,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.89000000000000001,"15min":0.93200000000000005},"min":{"1min":0.66300000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.135},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.89000000000000001,"15min":0.94499999999999995},"min":{"1min":0.64800000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":1.179}]},{"osd":7,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.0860000000000001,"15min":1.0549999999999999},"min":{"1min":0.63500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.766,"5min":12.766,"15min":12.766},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.716,"5min":1.091,"15min":1.083},"min":{"1min":0.77700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":12.788,"5min":12.788,"15min":12.788},"last":1.2889999999999999}]}]},{"osd":4,"up_from":16,"seq":68719476942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405736,"kb_used_data":53920,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93966104,"statfs":{"total":96636764160,"available":96221290496,"internally_reserved":0,"allocated":55214080,"data_stored":54845832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":360249799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.74199999999999999,"15min":0.71799999999999997},"min":{"1min":0.42599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2629999999999999,"5min":2.536,"15min":2.536},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.65100000000000002,"15min":0.69499999999999995},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":1.335,"15min":1.946},"last":0.91300000000000003}]},{"osd":1,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.39000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.081,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.754,"5min":0.92600000000000005,"15min":0.86199999999999999},"min":{"1min":0.498,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":17.451000000000001,"5min":17.451000000000001,"15min":17.451000000000001},"last":1.0429999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.48299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.202,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.81699999999999995,"15min":0.84999999999999998},"min":{"1min":0.55000000000000004,"5min":0.31,"15min":0.31},"max":{"1min":1.698,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.6799999999999999,"5min":2.681,"15min":2.681},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.631,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.79900000000000004}]},{"osd":5,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.78300000000000003,"15min":0.84699999999999998},"min":{"1min":0.52500000000000002,"5min":0.307,"15min":0.251},"max":{"1min":1.3069999999999999,"5min":2.613,"15min":4.7119999999999997},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.80400000000000005,"15min":0.88500000000000001},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":1.357,"5min":1.393,"15min":4.7480000000000002},"last":1.0980000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.88100000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3540000000000001,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.099,"5min":0.90300000000000002,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.7749999999999999,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":0.94699999999999995}]},{"osd":7,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.85999999999999999,"15min":0.93600000000000005},"min":{"1min":0.439,"5min":0.31,"15min":0.31},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":3.96},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":0.98299999999999998,"15min":1.028},"min":{"1min":0.67200000000000004,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.5509999999999999,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.0680000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509647,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260836,"kb_used_data":45212,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111004,"statfs":{"total":96636764160,"available":96369668096,"internally_reserved":0,"allocated":46297088,"data_stored":45936802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":0.80900000000000005,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.56100000000000005,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.96199999999999997}]},{"osd":1,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.99299999999999999,"5min":1.1759999999999999,"15min":1.3149999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.028,"5min":1.1839999999999999,"15min":1.3},"last":0.878}]},{"osd":3,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84699999999999998,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.254,"15min":0.254},"max":{"1min":0.91000000000000003,"5min":12.778,"15min":12.778},"last":0.755},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.94999999999999996,"15min":0.82499999999999996},"min":{"1min":0.55700000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5780000000000001,"5min":12.84,"15min":12.84},"last":0.91300000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.026,"5min":1.526,"15min":1.526},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.99199999999999999,"15min":0.95799999999999996},"min":{"1min":0.745,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2649999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":1.3029999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.095,"15min":1.0089999999999999},"min":{"1min":0.48499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3939999999999999,"5min":12.807,"15min":12.807},"last":1.044},{"interface":"front","average":{"1min":2.3130000000000002,"5min":1.4370000000000001,"15min":1.1220000000000001},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":24.102,"5min":24.102,"15min":24.102},"last":1.1339999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.016,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4079999999999999,"5min":1.4810000000000001,"15min":2.4260000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.038,"15min":1.038},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.1180000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0489999999999999,"15min":1.0409999999999999},"min":{"1min":0.67800000000000005,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.133,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.0449999999999999,"15min":1.069},"min":{"1min":0.78100000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3400000000000001,"5min":1.518,"15min":1.8320000000000001},"last":1.3400000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509647,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410668,"kb_used_data":90788,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961172,"statfs":{"total":96636764160,"available":96216240128,"internally_reserved":0,"allocated":92966912,"data_stored":92594645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.1359999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.0189999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0620000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.995}]},{"osd":3,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.80800000000000005},"min":{"1min":0.38100000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.0289999999999999,"5min":2.8170000000000002,"15min":4.069},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":1.1259999999999999}]},{"osd":4,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.88700000000000001,"15min":0.86399999999999999},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.339,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.075}]},{"osd":5,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.5860000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2130000000000001,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.92200000000000004}]},{"osd":6,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0740000000000001},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.29,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.204},{"interface":"front","average":{"1min":1.095,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.48699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.484}]},{"osd":7,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.56000000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2370000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.145},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":4.1509999999999998,"5min":4.1509999999999998,"15min":4.798},"last":1.631}]}]},{"osd":3,"up_from":14,"seq":60129542351,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319168,"kb_used_data":49336,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052672,"statfs":{"total":96636764160,"available":96309936128,"internally_reserved":0,"allocated":50520064,"data_stored":50148196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.1659999999999999,"5min":0.77800000000000002,"15min":0.71299999999999997},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":11.132,"5min":11.132,"15min":11.132},"last":0.877}]},{"osd":1,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.30199999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.421,"5min":1.857,"15min":3.3839999999999999},"last":0.746},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.71399999999999997}]},{"osd":2,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.86399999999999999,"15min":0.78200000000000003},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.331,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":0.90200000000000002}]},{"osd":4,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.872,"15min":0.876},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.95999999999999996,"15min":0.94699999999999995},"min":{"1min":0.504,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":2.609,"15min":2.609},"last":0.96499999999999997}]},{"osd":5,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.999},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":1.008},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.587,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.21}]},{"osd":6,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.6259999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.095,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.171}]},{"osd":7,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.157,"15min":1.0860000000000001},"min":{"1min":0.54600000000000004,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":13.02,"5min":13.02,"15min":13.02},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":1.893,"15min":1.9139999999999999},"last":1.234}]}]},{"osd":0,"up_from":14,"seq":60129542350,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263664,"kb_used_data":34024,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108176,"statfs":{"total":96636764160,"available":96366772224,"internally_reserved":0,"allocated":34840576,"data_stored":34469140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.68000000000000005,"15min":0.621},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.0229999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.37,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.0140000000000002,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96599999999999997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.82199999999999995,"15min":0.77100000000000002},"min":{"1min":0.41199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.226,"5min":0.93000000000000005,"15min":0.85599999999999998},"min":{"1min":0.48399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.76800000000000002}]},{"osd":4,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.66000000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.125,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":1.02}]},{"osd":5,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0169999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":5.0650000000000004,"5min":14.869,"15min":14.869},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.0880000000000001,"15min":1.022},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4870000000000001,"5min":14.804,"15min":14.804},"last":1.119}]},{"osd":6,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.157,"15min":1.0660000000000001},"min":{"1min":0.64300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.4049999999999994,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4259999999999999,"5min":2.113,"15min":2.113},"last":1.198}]},{"osd":7,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.455,"5min":11.455,"15min":11.455},"last":1.089},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.294,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":11.430999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.2709999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106119168,"data_stored":106112848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80957440,"data_stored":80947606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":32851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":45093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":36924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:26:01.862 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.862 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.863 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.864 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.864 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.864 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.864 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.864 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.864 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.865 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.866 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.867 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.867 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.867 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.867 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.867 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.867 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.868 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.868 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.868 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.868 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.868 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.868 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.869 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.869 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.869 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.869 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.869 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.869 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.870 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-18T18:09:11.405580+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.871 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.871 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:01.871 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T18:26:21.872 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:26:21.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 Processor -- start 2024-03-18T18:26:21.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 -- start start 2024-03-18T18:26:21.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb80b2690 0x7f4fb8143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:21.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4fb813cf70 0x7f4fb813d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:21.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb806f800 con 0x7f4fb80aef20 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb806eb40 con 0x7f4fb813cf70 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.990+0000 7f4fbe589700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb813d960 con 0x7f4fb80b2690 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4fb813cf70 0x7f4fb813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4fb813cf70 0x7f4fb813d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35786/0 (socket says 172.21.15.94:35786) 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 -- 172.21.15.94:0/86875714 learned_addr learned my addr 172.21.15.94:0/86875714 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbd587700 1 --2- 172.21.15.94:0/86875714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb80b2690 0x7f4fb8143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 -- 172.21.15.94:0/86875714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb80b2690 msgr2=0x7f4fb8143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 --2- 172.21.15.94:0/86875714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb80b2690 0x7f4fb8143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:21.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 -- 172.21.15.94:0/86875714 >> v1:172.21.15.151:6789/0 conn(0x7f4fb80aef20 legacy=0x7f4fb80b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:21.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 -- 172.21.15.94:0/86875714 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80af320 con 0x7f4fb813cf70 2024-03-18T18:26:21.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbdd88700 1 --2- 172.21.15.94:0/86875714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb813cf70 0x7f4fb813d420 secure :-1 s=READY pgs=4530 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009940 tx=0x7f4fb0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e00c88512fda22 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:21.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4faffff700 1 -- 172.21.15.94:0/86875714 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0011830 con 0x7f4fb813cf70 2024-03-18T18:26:21.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4faffff700 1 -- 172.21.15.94:0/86875714 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0011990 con 0x7f4fb813cf70 2024-03-18T18:26:21.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4faffff700 1 -- 172.21.15.94:0/86875714 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0011d20 con 0x7f4fb813cf70 2024-03-18T18:26:21.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 -- 172.21.15.94:0/86875714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb813cf70 msgr2=0x7f4fb813d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:21.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 --2- 172.21.15.94:0/86875714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb813cf70 0x7f4fb813d420 secure :-1 s=READY pgs=4530 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009940 tx=0x7f4fb0009c50 comp rx=0 tx=0).stop 2024-03-18T18:26:21.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 -- 172.21.15.94:0/86875714 shutdown_connections 2024-03-18T18:26:22.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 --2- 172.21.15.94:0/86875714 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb813cf70 0x7f4fb813d420 unknown :-1 s=CLOSED pgs=4530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 --2- 172.21.15.94:0/86875714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb80b2690 0x7f4fb8143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 -- 172.21.15.94:0/86875714 >> 172.21.15.94:0/86875714 conn(0x7f4fb80b7a20 msgr2=0x7f4fb80b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:22.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 -- 172.21.15.94:0/86875714 shutdown_connections 2024-03-18T18:26:22.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.994+0000 7f4fbe589700 1 -- 172.21.15.94:0/86875714 wait complete. 2024-03-18T18:26:22.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:22.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 Processor -- start 2024-03-18T18:26:22.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 -- start start 2024-03-18T18:26:22.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb80aef20 0x7f4fb8133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:22.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 0x7f4fb81db6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:22.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb813cf70 0x7f4fb81dbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb81db270 con 0x7f4fb80b2690 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb813e6b0 con 0x7f4fb80aef20 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8139310 con 0x7f4fb813cf70 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 0x7f4fb81db6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 0x7f4fb81db6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:35800/0 (socket says 172.21.15.94:35800) 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 -- 172.21.15.94:0/3042166255 learned_addr learned my addr 172.21.15.94:0/3042166255 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbd587700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb80aef20 0x7f4fb8133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbdd88700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb813cf70 0x7f4fb81dbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:22.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 -- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb813cf70 msgr2=0x7f4fb81dbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb813cf70 0x7f4fb81dbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 -- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb80aef20 msgr2=0x7f4fb8133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb80aef20 0x7f4fb8133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 -- 172.21.15.94:0/3042166255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009570 con 0x7f4fb80b2690 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbdd88700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb813cf70 0x7f4fb81dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbcd86700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 0x7f4fb81db6c0 secure :-1 s=READY pgs=4531 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400cc20 tx=0x7f4fb400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:22.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4003c20 con 0x7f4fb80b2690 2024-03-18T18:26:22.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4003d80 con 0x7f4fb80b2690 2024-03-18T18:26:22.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400ab90 con 0x7f4fb80b2690 2024-03-18T18:26:22.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb81395f0 con 0x7f4fb80b2690 2024-03-18T18:26:22.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:21.998+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb8142160 con 0x7f4fb80b2690 2024-03-18T18:26:22.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:22.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.002+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb81397e0 con 0x7f4fb80b2690 2024-03-18T18:26:22.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.002+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4fb400acf0 con 0x7f4fb80b2690 2024-03-18T18:26:22.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.002+0000 7f4fadffb700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4f9c066760 0x7f4f9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:22.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.002+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4fb40842d0 con 0x7f4fb80b2690 2024-03-18T18:26:22.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.002+0000 7f4fbd587700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4f9c066760 0x7f4f9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:22.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.002+0000 7f4fbd587700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4f9c066760 0x7f4f9c068c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009bf0 tx=0x7f4fa8009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:22.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.010+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4fb4051530 con 0x7f4fb80b2690 2024-03-18T18:26:22.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.174+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fb81422f0 con 0x7f4f9c066760 2024-03-18T18:26:22.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.190+0000 7f4fadffb700 1 -- 172.21.15.94:0/3042166255 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292450 (secure 0 0 0) 0x7f4fb81422f0 con 0x7f4f9c066760 2024-03-18T18:26:22.198 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4f9c066760 msgr2=0x7f4f9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4f9c066760 0x7f4f9c068c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009bf0 tx=0x7f4fa8009240 comp rx=0 tx=0).stop 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 msgr2=0x7f4fb81db6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 0x7f4fb81db6c0 secure :-1 s=READY pgs=4531 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400cc20 tx=0x7f4fb400cf30 comp rx=0 tx=0).stop 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 shutdown_connections 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f4f9c066760 0x7f4f9c068c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4fb813cf70 0x7f4fb81dbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4fb80b2690 0x7f4fb81db6c0 unknown :-1 s=CLOSED pgs=4531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 --2- 172.21.15.94:0/3042166255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb80aef20 0x7f4fb8133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:22.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 >> 172.21.15.94:0/3042166255 conn(0x7f4fb80b7a20 msgr2=0x7f4fb80b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:22.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 shutdown_connections 2024-03-18T18:26:22.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:22.194+0000 7f4fbe589700 1 -- 172.21.15.94:0/3042166255 wait complete. 2024-03-18T18:26:22.202 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:26:22.216 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2024-03-18T18:26:20.930734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265707618,"num_objects":228,"num_object_clones":28,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":15,"num_read":1722,"num_read_kb":4075,"num_write":163797,"num_write_kb":738450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35843,"num_omap_keys":70,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327330,"ondisk_log_size":327330,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2946784,"kb_used_data":524128,"kb_used_omap":12,"kb_used_meta":2422579,"kb_avail":752027936,"statfs":{"total":773094113280,"available":770076606464,"internally_reserved":0,"allocated":536707072,"data_stored":533742460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2480721468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004451"},"pg_stats":[{"pgid":"3.3f","version":"54'3532","reported_seq":2944,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.145813+0000","last_change":"2024-03-18T18:25:29.057112+0000","last_active":"2024-03-18T18:25:41.145813+0000","last_peered":"2024-03-18T18:25:41.145813+0000","last_clean":"2024-03-18T18:25:41.145813+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:25:41.145813+0000","last_undegraded":"2024-03-18T18:25:41.145813+0000","last_fullsized":"2024-03-18T18:25:41.145813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"54'3322","reported_seq":2762,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:15.166796+0000","last_change":"2024-03-18T18:26:15.167274+0000","last_active":"2024-03-18T18:26:15.166796+0000","last_peered":"2024-03-18T18:26:15.166796+0000","last_clean":"2024-03-18T18:26:15.166796+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:26:15.166796+0000","last_undegraded":"2024-03-18T18:26:15.166796+0000","last_fullsized":"2024-03-18T18:26:15.166796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3322","last_scrub_stamp":"2024-03-18T18:26:15.166730+0000","last_deep_scrub":"54'3322","last_deep_scrub_stamp":"2024-03-18T18:26:15.166730+0000","last_clean_scrub_stamp":"2024-03-18T18:26:15.166730+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:15:08.335174+0000","scrub_duration":0.026966192999999999,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"56'3571","reported_seq":2994,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:58.807809+0000","last_change":"2024-03-18T18:25:58.807942+0000","last_active":"2024-03-18T18:25:58.807809+0000","last_peered":"2024-03-18T18:25:58.807809+0000","last_clean":"2024-03-18T18:25:58.807809+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:58.807809+0000","last_undegraded":"2024-03-18T18:25:58.807809+0000","last_fullsized":"2024-03-18T18:25:58.807809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3571","last_scrub_stamp":"2024-03-18T18:25:58.807786+0000","last_deep_scrub":"56'3571","last_deep_scrub_stamp":"2024-03-18T18:25:58.807786+0000","last_clean_scrub_stamp":"2024-03-18T18:25:58.807786+0000","objects_scrubbed":1,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:27.440135+0000","scrub_duration":0.034988533000000002,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"54'3829","reported_seq":3141,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820459+0000","last_change":"2024-03-18T18:25:29.029488+0000","last_active":"2024-03-18T18:25:37.820459+0000","last_peered":"2024-03-18T18:25:37.820459+0000","last_clean":"2024-03-18T18:25:37.820459+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:25:37.820459+0000","last_undegraded":"2024-03-18T18:25:37.820459+0000","last_fullsized":"2024-03-18T18:25:37.820459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3829,"log_dups_size":0,"ondisk_log_size":3829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"54'3564","reported_seq":2931,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751153+0000","last_change":"2024-03-18T18:25:29.053880+0000","last_active":"2024-03-18T18:25:37.751153+0000","last_peered":"2024-03-18T18:25:37.751153+0000","last_clean":"2024-03-18T18:25:37.751153+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:25:37.751153+0000","last_undegraded":"2024-03-18T18:25:37.751153+0000","last_fullsized":"2024-03-18T18:25:37.751153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"56'3683","reported_seq":3025,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:14.003967+0000","last_change":"2024-03-18T18:26:14.004088+0000","last_active":"2024-03-18T18:26:14.003967+0000","last_peered":"2024-03-18T18:26:14.003967+0000","last_clean":"2024-03-18T18:26:14.003967+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:26:14.003967+0000","last_undegraded":"2024-03-18T18:26:14.003967+0000","last_fullsized":"2024-03-18T18:26:14.003967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3683","last_scrub_stamp":"2024-03-18T18:26:14.003947+0000","last_deep_scrub":"56'3683","last_deep_scrub_stamp":"2024-03-18T18:26:14.003947+0000","last_clean_scrub_stamp":"2024-03-18T18:26:14.003947+0000","objects_scrubbed":2,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:51:24.504478+0000","scrub_duration":0.036112544000000003,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"54'3919","reported_seq":3245,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750631+0000","last_change":"2024-03-18T18:25:29.050955+0000","last_active":"2024-03-18T18:25:37.750631+0000","last_peered":"2024-03-18T18:25:37.750631+0000","last_clean":"2024-03-18T18:25:37.750631+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:25:37.750631+0000","last_undegraded":"2024-03-18T18:25:37.750631+0000","last_fullsized":"2024-03-18T18:25:37.750631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"56'3532","reported_seq":2956,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:02.052898+0000","last_change":"2024-03-18T18:26:02.053047+0000","last_active":"2024-03-18T18:26:02.052898+0000","last_peered":"2024-03-18T18:26:02.052898+0000","last_clean":"2024-03-18T18:26:02.052898+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:26:02.052898+0000","last_undegraded":"2024-03-18T18:26:02.052898+0000","last_fullsized":"2024-03-18T18:26:02.052898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3532","last_scrub_stamp":"2024-03-18T18:26:02.052878+0000","last_deep_scrub":"56'3532","last_deep_scrub_stamp":"2024-03-18T18:26:02.052878+0000","last_clean_scrub_stamp":"2024-03-18T18:26:02.052878+0000","objects_scrubbed":4,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:25:01.236731+0000","scrub_duration":0.051984388999999999,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"54'3888","reported_seq":3250,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.145740+0000","last_change":"2024-03-18T18:25:29.056418+0000","last_active":"2024-03-18T18:25:41.145740+0000","last_peered":"2024-03-18T18:25:41.145740+0000","last_clean":"2024-03-18T18:25:41.145740+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:25:41.145740+0000","last_undegraded":"2024-03-18T18:25:41.145740+0000","last_fullsized":"2024-03-18T18:25:41.145740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3888,"log_dups_size":0,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"54'3828","reported_seq":3248,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.659234+0000","last_change":"2024-03-18T18:25:29.022953+0000","last_active":"2024-03-18T18:25:40.659234+0000","last_peered":"2024-03-18T18:25:40.659234+0000","last_clean":"2024-03-18T18:25:40.659234+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:25:40.659234+0000","last_undegraded":"2024-03-18T18:25:40.659234+0000","last_fullsized":"2024-03-18T18:25:40.659234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"56'3543","reported_seq":2982,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.070491+0000","last_change":"2024-03-18T18:26:11.070597+0000","last_active":"2024-03-18T18:26:11.070491+0000","last_peered":"2024-03-18T18:26:11.070491+0000","last_clean":"2024-03-18T18:26:11.070491+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:26:11.070491+0000","last_undegraded":"2024-03-18T18:26:11.070491+0000","last_fullsized":"2024-03-18T18:26:11.070491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3543","last_scrub_stamp":"2024-03-18T18:26:11.070467+0000","last_deep_scrub":"56'3543","last_deep_scrub_stamp":"2024-03-18T18:26:11.070467+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.070467+0000","objects_scrubbed":1,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:51:21.570999+0000","scrub_duration":0.030295255,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"54'4127","reported_seq":3435,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:55.455436+0000","last_change":"2024-03-18T18:25:55.455436+0000","last_active":"2024-03-18T18:25:55.455436+0000","last_peered":"2024-03-18T18:25:55.455436+0000","last_clean":"2024-03-18T18:25:55.455436+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:55.455436+0000","last_undegraded":"2024-03-18T18:25:55.455436+0000","last_fullsized":"2024-03-18T18:25:55.455436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4127","last_scrub_stamp":"2024-03-18T18:25:55.455217+0000","last_deep_scrub":"54'4127","last_deep_scrub_stamp":"2024-03-18T18:25:55.455217+0000","last_clean_scrub_stamp":"2024-03-18T18:25:55.455217+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:39:08.916529+0000","scrub_duration":0.047245723000000003,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"54'3608","reported_seq":3018,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:39.192328+0000","last_change":"2024-03-18T18:25:29.043841+0000","last_active":"2024-03-18T18:25:39.192328+0000","last_peered":"2024-03-18T18:25:39.192328+0000","last_clean":"2024-03-18T18:25:39.192328+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:25:39.192328+0000","last_undegraded":"2024-03-18T18:25:39.192328+0000","last_fullsized":"2024-03-18T18:25:39.192328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3608,"log_dups_size":0,"ondisk_log_size":3608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"56'3872","reported_seq":3185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:57.777261+0000","last_change":"2024-03-18T18:25:57.777426+0000","last_active":"2024-03-18T18:25:57.777261+0000","last_peered":"2024-03-18T18:25:57.777261+0000","last_clean":"2024-03-18T18:25:57.777261+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:57.777261+0000","last_undegraded":"2024-03-18T18:25:57.777261+0000","last_fullsized":"2024-03-18T18:25:57.777261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3872","last_scrub_stamp":"2024-03-18T18:25:57.777233+0000","last_deep_scrub":"56'3872","last_deep_scrub_stamp":"2024-03-18T18:25:57.777233+0000","last_clean_scrub_stamp":"2024-03-18T18:25:57.777233+0000","objects_scrubbed":1,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:16:52.332974+0000","scrub_duration":0.035250040000000003,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"56'3833","reported_seq":3170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:10.199717+0000","last_change":"2024-03-18T18:26:10.199906+0000","last_active":"2024-03-18T18:26:10.199717+0000","last_peered":"2024-03-18T18:26:10.199717+0000","last_clean":"2024-03-18T18:26:10.199717+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:26:10.199717+0000","last_undegraded":"2024-03-18T18:26:10.199717+0000","last_fullsized":"2024-03-18T18:26:10.199717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3833","last_scrub_stamp":"2024-03-18T18:26:10.199681+0000","last_deep_scrub":"56'3833","last_deep_scrub_stamp":"2024-03-18T18:26:10.199681+0000","last_clean_scrub_stamp":"2024-03-18T18:26:10.199681+0000","objects_scrubbed":4,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:53:19.324884+0000","scrub_duration":0.054462076999999998,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"54'4022","reported_seq":3334,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818024+0000","last_change":"2024-03-18T18:25:29.024791+0000","last_active":"2024-03-18T18:25:37.818024+0000","last_peered":"2024-03-18T18:25:37.818024+0000","last_clean":"2024-03-18T18:25:37.818024+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:25:37.818024+0000","last_undegraded":"2024-03-18T18:25:37.818024+0000","last_fullsized":"2024-03-18T18:25:37.818024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"54'3796","reported_seq":3116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:07.466110+0000","last_change":"2024-03-18T18:26:07.466237+0000","last_active":"2024-03-18T18:26:07.466110+0000","last_peered":"2024-03-18T18:26:07.466110+0000","last_clean":"2024-03-18T18:26:07.466110+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:26:07.466110+0000","last_undegraded":"2024-03-18T18:26:07.466110+0000","last_fullsized":"2024-03-18T18:26:07.466110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3796","last_scrub_stamp":"2024-03-18T18:26:07.466087+0000","last_deep_scrub":"54'3796","last_deep_scrub_stamp":"2024-03-18T18:26:07.466087+0000","last_clean_scrub_stamp":"2024-03-18T18:26:07.466087+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:14:10.043992+0000","scrub_duration":0.031304364000000001,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"56'3742","reported_seq":3157,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.967487+0000","last_change":"2024-03-18T18:25:46.967699+0000","last_active":"2024-03-18T18:25:46.967487+0000","last_peered":"2024-03-18T18:25:46.967487+0000","last_clean":"2024-03-18T18:25:46.967487+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:46.967487+0000","last_undegraded":"2024-03-18T18:25:46.967487+0000","last_fullsized":"2024-03-18T18:25:46.967487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3742","last_scrub_stamp":"2024-03-18T18:25:46.967421+0000","last_deep_scrub":"56'3742","last_deep_scrub_stamp":"2024-03-18T18:25:46.967421+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.967421+0000","objects_scrubbed":4,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:39:00.428733+0000","scrub_duration":0.041615524000000001,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"54'3972","reported_seq":3276,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.752253+0000","last_change":"2024-03-18T18:25:29.055765+0000","last_active":"2024-03-18T18:25:37.752253+0000","last_peered":"2024-03-18T18:25:37.752253+0000","last_clean":"2024-03-18T18:25:37.752253+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:25:37.752253+0000","last_undegraded":"2024-03-18T18:25:37.752253+0000","last_fullsized":"2024-03-18T18:25:37.752253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3972,"log_dups_size":0,"ondisk_log_size":3972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"56'3759","reported_seq":3132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:16.023642+0000","last_change":"2024-03-18T18:26:16.023774+0000","last_active":"2024-03-18T18:26:16.023642+0000","last_peered":"2024-03-18T18:26:16.023642+0000","last_clean":"2024-03-18T18:26:16.023642+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:26:16.023642+0000","last_undegraded":"2024-03-18T18:26:16.023642+0000","last_fullsized":"2024-03-18T18:26:16.023642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3759","last_scrub_stamp":"2024-03-18T18:26:16.023618+0000","last_deep_scrub":"56'3759","last_deep_scrub_stamp":"2024-03-18T18:26:16.023618+0000","last_clean_scrub_stamp":"2024-03-18T18:26:16.023618+0000","objects_scrubbed":4,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:18.007659+0000","scrub_duration":0.058141316999999998,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"56'3499","reported_seq":2932,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:08.839985+0000","last_change":"2024-03-18T18:26:08.840282+0000","last_active":"2024-03-18T18:26:08.839985+0000","last_peered":"2024-03-18T18:26:08.839985+0000","last_clean":"2024-03-18T18:26:08.839985+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:26:08.839985+0000","last_undegraded":"2024-03-18T18:26:08.839985+0000","last_fullsized":"2024-03-18T18:26:08.839985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3499","last_scrub_stamp":"2024-03-18T18:26:08.839925+0000","last_deep_scrub":"56'3499","last_deep_scrub_stamp":"2024-03-18T18:26:08.839925+0000","last_clean_scrub_stamp":"2024-03-18T18:26:08.839925+0000","objects_scrubbed":4,"log_size":3499,"log_dups_size":0,"ondisk_log_size":3499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:12:07.915856+0000","scrub_duration":0.052096138,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"54'4356","reported_seq":3576,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.820036+0000","last_change":"2024-03-18T18:25:29.035858+0000","last_active":"2024-03-18T18:25:37.820036+0000","last_peered":"2024-03-18T18:25:37.820036+0000","last_clean":"2024-03-18T18:25:37.820036+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:25:37.820036+0000","last_undegraded":"2024-03-18T18:25:37.820036+0000","last_fullsized":"2024-03-18T18:25:37.820036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4356,"log_dups_size":0,"ondisk_log_size":4356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"54'3901","reported_seq":3246,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:01.029665+0000","last_change":"2024-03-18T18:26:01.029944+0000","last_active":"2024-03-18T18:26:01.029665+0000","last_peered":"2024-03-18T18:26:01.029665+0000","last_clean":"2024-03-18T18:26:01.029665+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:26:01.029665+0000","last_undegraded":"2024-03-18T18:26:01.029665+0000","last_fullsized":"2024-03-18T18:26:01.029665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3901","last_scrub_stamp":"2024-03-18T18:26:01.029608+0000","last_deep_scrub":"54'3901","last_deep_scrub_stamp":"2024-03-18T18:26:01.029608+0000","last_clean_scrub_stamp":"2024-03-18T18:26:01.029608+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:16:55.585349+0000","scrub_duration":0.047324324000000001,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"54'4190","reported_seq":3411,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.818932+0000","last_change":"2024-03-18T18:25:29.027847+0000","last_active":"2024-03-18T18:25:37.818932+0000","last_peered":"2024-03-18T18:25:37.818932+0000","last_clean":"2024-03-18T18:25:37.818932+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:25:37.818932+0000","last_undegraded":"2024-03-18T18:25:37.818932+0000","last_fullsized":"2024-03-18T18:25:37.818932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"54'3282","reported_seq":2726,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.749830+0000","last_change":"2024-03-18T18:25:29.043669+0000","last_active":"2024-03-18T18:25:37.749830+0000","last_peered":"2024-03-18T18:25:37.749830+0000","last_clean":"2024-03-18T18:25:37.749830+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:25:37.749830+0000","last_undegraded":"2024-03-18T18:25:37.749830+0000","last_fullsized":"2024-03-18T18:25:37.749830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"56'3789","reported_seq":3163,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:17.998708+0000","last_change":"2024-03-18T18:26:17.998899+0000","last_active":"2024-03-18T18:26:17.998708+0000","last_peered":"2024-03-18T18:26:17.998708+0000","last_clean":"2024-03-18T18:26:17.998708+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:26:17.998708+0000","last_undegraded":"2024-03-18T18:26:17.998708+0000","last_fullsized":"2024-03-18T18:26:17.998708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3789","last_scrub_stamp":"2024-03-18T18:26:17.998677+0000","last_deep_scrub":"56'3789","last_deep_scrub_stamp":"2024-03-18T18:26:17.998677+0000","last_clean_scrub_stamp":"2024-03-18T18:26:17.998677+0000","objects_scrubbed":4,"log_size":3789,"log_dups_size":0,"ondisk_log_size":3789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:19:47.884453+0000","scrub_duration":0.048054445000000001,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"56'3858","reported_seq":3188,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:19.183447+0000","last_change":"2024-03-18T18:26:19.183573+0000","last_active":"2024-03-18T18:26:19.183447+0000","last_peered":"2024-03-18T18:26:19.183447+0000","last_clean":"2024-03-18T18:26:19.183447+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:26:19.183447+0000","last_undegraded":"2024-03-18T18:26:19.183447+0000","last_fullsized":"2024-03-18T18:26:19.183447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3858","last_scrub_stamp":"2024-03-18T18:26:19.183428+0000","last_deep_scrub":"56'3858","last_deep_scrub_stamp":"2024-03-18T18:26:19.183428+0000","last_clean_scrub_stamp":"2024-03-18T18:26:19.183428+0000","objects_scrubbed":1,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:15:23.915649+0000","scrub_duration":0.036337407000000002,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"54'3360","reported_seq":2816,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:02.004361+0000","last_change":"2024-03-18T18:26:02.004463+0000","last_active":"2024-03-18T18:26:02.004361+0000","last_peered":"2024-03-18T18:26:02.004361+0000","last_clean":"2024-03-18T18:26:02.004361+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:26:02.004361+0000","last_undegraded":"2024-03-18T18:26:02.004361+0000","last_fullsized":"2024-03-18T18:26:02.004361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3360","last_scrub_stamp":"2024-03-18T18:26:02.004337+0000","last_deep_scrub":"54'3360","last_deep_scrub_stamp":"2024-03-18T18:26:02.004337+0000","last_clean_scrub_stamp":"2024-03-18T18:26:02.004337+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:30.636687+0000","scrub_duration":0.037008526,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"56'3865","reported_seq":3218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:07.818562+0000","last_change":"2024-03-18T18:26:07.818741+0000","last_active":"2024-03-18T18:26:07.818562+0000","last_peered":"2024-03-18T18:26:07.818562+0000","last_clean":"2024-03-18T18:26:07.818562+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:26:07.818562+0000","last_undegraded":"2024-03-18T18:26:07.818562+0000","last_fullsized":"2024-03-18T18:26:07.818562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3865","last_scrub_stamp":"2024-03-18T18:26:07.818529+0000","last_deep_scrub":"56'3865","last_deep_scrub_stamp":"2024-03-18T18:26:07.818529+0000","last_clean_scrub_stamp":"2024-03-18T18:26:07.818529+0000","objects_scrubbed":3,"log_size":3865,"log_dups_size":0,"ondisk_log_size":3865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:08:09.756202+0000","scrub_duration":0.033042113999999997,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"54'3275","reported_seq":2727,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.180105+0000","last_change":"2024-03-18T18:25:29.038378+0000","last_active":"2024-03-18T18:25:40.180105+0000","last_peered":"2024-03-18T18:25:40.180105+0000","last_clean":"2024-03-18T18:25:40.180105+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:25:40.180105+0000","last_undegraded":"2024-03-18T18:25:40.180105+0000","last_fullsized":"2024-03-18T18:25:40.180105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"56'4262","reported_seq":3518,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.968689+0000","last_change":"2024-03-18T18:25:47.968689+0000","last_active":"2024-03-18T18:25:47.968689+0000","last_peered":"2024-03-18T18:25:47.968689+0000","last_clean":"2024-03-18T18:25:47.968689+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:47.968689+0000","last_undegraded":"2024-03-18T18:25:47.968689+0000","last_fullsized":"2024-03-18T18:25:47.968689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4262","last_scrub_stamp":"2024-03-18T18:25:47.968474+0000","last_deep_scrub":"56'4262","last_deep_scrub_stamp":"2024-03-18T18:25:47.968474+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.968474+0000","objects_scrubbed":2,"log_size":4262,"log_dups_size":0,"ondisk_log_size":4262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:48.817587+0000","scrub_duration":0.043698319999999999,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"56'3988","reported_seq":3291,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:17.008031+0000","last_change":"2024-03-18T18:26:17.008207+0000","last_active":"2024-03-18T18:26:17.008031+0000","last_peered":"2024-03-18T18:26:17.008031+0000","last_clean":"2024-03-18T18:26:17.008031+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:26:17.008031+0000","last_undegraded":"2024-03-18T18:26:17.008031+0000","last_fullsized":"2024-03-18T18:26:17.008031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3988","last_scrub_stamp":"2024-03-18T18:26:17.008005+0000","last_deep_scrub":"56'3988","last_deep_scrub_stamp":"2024-03-18T18:26:17.008005+0000","last_clean_scrub_stamp":"2024-03-18T18:26:17.008005+0000","objects_scrubbed":3,"log_size":3988,"log_dups_size":0,"ondisk_log_size":3988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:53:26.133208+0000","scrub_duration":0.044919591000000002,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4044","reported_seq":3329,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:52.496669+0000","last_change":"2024-03-18T18:25:52.496847+0000","last_active":"2024-03-18T18:25:52.496669+0000","last_peered":"2024-03-18T18:25:52.496669+0000","last_clean":"2024-03-18T18:25:52.496669+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:52.496669+0000","last_undegraded":"2024-03-18T18:25:52.496669+0000","last_fullsized":"2024-03-18T18:25:52.496669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4044","last_scrub_stamp":"2024-03-18T18:25:52.496642+0000","last_deep_scrub":"56'4044","last_deep_scrub_stamp":"2024-03-18T18:25:52.496642+0000","last_clean_scrub_stamp":"2024-03-18T18:25:52.496642+0000","objects_scrubbed":4,"log_size":4044,"log_dups_size":0,"ondisk_log_size":4044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:01.118815+0000","scrub_duration":0.055416811000000003,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"56'1441","reported_seq":1504,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.225181+0000","last_change":"2024-03-18T18:25:41.225345+0000","last_active":"2024-03-18T18:25:41.225181+0000","last_peered":"2024-03-18T18:25:41.225181+0000","last_clean":"2024-03-18T18:25:41.225181+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:41.225181+0000","last_undegraded":"2024-03-18T18:25:41.225181+0000","last_fullsized":"2024-03-18T18:25:41.225181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1441","last_scrub_stamp":"2024-03-18T18:25:41.225139+0000","last_deep_scrub":"56'1441","last_deep_scrub_stamp":"2024-03-18T18:25:41.225139+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.225139+0000","objects_scrubbed":2,"log_size":1441,"log_dups_size":0,"ondisk_log_size":1441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:00:20.198746+0000","scrub_duration":0.033432481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2995,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.809478+0000","last_change":"2024-03-18T18:25:59.809603+0000","last_active":"2024-03-18T18:25:59.809478+0000","last_peered":"2024-03-18T18:25:59.809478+0000","last_clean":"2024-03-18T18:25:59.809478+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:59.809478+0000","last_undegraded":"2024-03-18T18:25:59.809478+0000","last_fullsized":"2024-03-18T18:25:59.809478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3624","last_scrub_stamp":"2024-03-18T18:25:59.809455+0000","last_deep_scrub":"54'3624","last_deep_scrub_stamp":"2024-03-18T18:25:59.809455+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.809455+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:04:29.317286+0000","scrub_duration":0.036057659999999998,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"56'3529","reported_seq":3592,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.844515+0000","last_change":"2024-03-18T18:25:43.844735+0000","last_active":"2024-03-18T18:25:43.844515+0000","last_peered":"2024-03-18T18:25:43.844515+0000","last_clean":"2024-03-18T18:25:43.844515+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:43.844515+0000","last_undegraded":"2024-03-18T18:25:43.844515+0000","last_fullsized":"2024-03-18T18:25:43.844515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3529","last_scrub_stamp":"2024-03-18T18:25:43.844458+0000","last_deep_scrub":"56'3529","last_deep_scrub_stamp":"2024-03-18T18:25:43.844458+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.844458+0000","objects_scrubbed":2,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:01:59.288139+0000","scrub_duration":0.048300498999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"56'682","reported_seq":746,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:45.126364+0000","last_change":"2024-03-18T18:25:45.126364+0000","last_active":"2024-03-18T18:25:45.126364+0000","last_peered":"2024-03-18T18:25:45.126364+0000","last_clean":"2024-03-18T18:25:45.126364+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:45.126364+0000","last_undegraded":"2024-03-18T18:25:45.126364+0000","last_fullsized":"2024-03-18T18:25:45.126364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'682","last_scrub_stamp":"2024-03-18T18:25:45.126076+0000","last_deep_scrub":"56'682","last_deep_scrub_stamp":"2024-03-18T18:25:45.126076+0000","last_clean_scrub_stamp":"2024-03-18T18:25:45.126076+0000","objects_scrubbed":3,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:19.202685+0000","scrub_duration":0.033214492999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"56'4462","reported_seq":3649,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:12.089969+0000","last_change":"2024-03-18T18:26:12.090327+0000","last_active":"2024-03-18T18:26:12.089969+0000","last_peered":"2024-03-18T18:26:12.089969+0000","last_clean":"2024-03-18T18:26:12.089969+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:26:12.089969+0000","last_undegraded":"2024-03-18T18:26:12.089969+0000","last_fullsized":"2024-03-18T18:26:12.089969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4462","last_scrub_stamp":"2024-03-18T18:26:12.089892+0000","last_deep_scrub":"56'4462","last_deep_scrub_stamp":"2024-03-18T18:26:12.089892+0000","last_clean_scrub_stamp":"2024-03-18T18:26:12.089892+0000","objects_scrubbed":1,"log_size":4462,"log_dups_size":0,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:08:14.027565+0000","scrub_duration":0.043130329000000002,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"56'5550","reported_seq":5614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.516523+0000","last_change":"2024-03-18T18:25:47.516523+0000","last_active":"2024-03-18T18:25:47.516523+0000","last_peered":"2024-03-18T18:25:47.516523+0000","last_clean":"2024-03-18T18:25:47.516523+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:47.516523+0000","last_undegraded":"2024-03-18T18:25:47.516523+0000","last_fullsized":"2024-03-18T18:25:47.516523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5550","last_scrub_stamp":"2024-03-18T18:25:47.516294+0000","last_deep_scrub":"56'5550","last_deep_scrub_stamp":"2024-03-18T18:25:47.516294+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.516294+0000","objects_scrubbed":4,"log_size":5550,"log_dups_size":0,"ondisk_log_size":5550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:33:26.469138+0000","scrub_duration":0.092072492000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"56'3915","reported_seq":3253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:16.204090+0000","last_change":"2024-03-18T18:26:16.204356+0000","last_active":"2024-03-18T18:26:16.204090+0000","last_peered":"2024-03-18T18:26:16.204090+0000","last_clean":"2024-03-18T18:26:16.204090+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:26:16.204090+0000","last_undegraded":"2024-03-18T18:26:16.204090+0000","last_fullsized":"2024-03-18T18:26:16.204090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3915","last_scrub_stamp":"2024-03-18T18:26:16.204032+0000","last_deep_scrub":"56'3915","last_deep_scrub_stamp":"2024-03-18T18:26:16.204032+0000","last_clean_scrub_stamp":"2024-03-18T18:26:16.204032+0000","objects_scrubbed":4,"log_size":3915,"log_dups_size":0,"ondisk_log_size":3915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:49.739786+0000","scrub_duration":0.044722550999999999,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"56'1870","reported_seq":1934,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:45.861089+0000","last_change":"2024-03-18T18:25:45.861089+0000","last_active":"2024-03-18T18:25:45.861089+0000","last_peered":"2024-03-18T18:25:45.861089+0000","last_clean":"2024-03-18T18:25:45.861089+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:45.861089+0000","last_undegraded":"2024-03-18T18:25:45.861089+0000","last_fullsized":"2024-03-18T18:25:45.861089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1870","last_scrub_stamp":"2024-03-18T18:25:45.860770+0000","last_deep_scrub":"56'1870","last_deep_scrub_stamp":"2024-03-18T18:25:45.860770+0000","last_clean_scrub_stamp":"2024-03-18T18:25:45.860770+0000","objects_scrubbed":6,"log_size":1870,"log_dups_size":0,"ondisk_log_size":1870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:25.178558+0000","scrub_duration":0.078756888999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18032374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1972,"num_write_kb":19324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"56'3673","reported_seq":3096,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:18.575823+0000","last_change":"2024-03-18T18:26:18.576108+0000","last_active":"2024-03-18T18:26:18.575823+0000","last_peered":"2024-03-18T18:26:18.575823+0000","last_clean":"2024-03-18T18:26:18.575823+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:26:18.575823+0000","last_undegraded":"2024-03-18T18:26:18.575823+0000","last_fullsized":"2024-03-18T18:26:18.575823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3673","last_scrub_stamp":"2024-03-18T18:26:18.575767+0000","last_deep_scrub":"56'3673","last_deep_scrub_stamp":"2024-03-18T18:26:18.575767+0000","last_clean_scrub_stamp":"2024-03-18T18:26:18.575767+0000","objects_scrubbed":4,"log_size":3673,"log_dups_size":0,"ondisk_log_size":3673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:29:17.022266+0000","scrub_duration":0.044973614000000002,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"56'2296","reported_seq":2360,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.484347+0000","last_change":"2024-03-18T18:25:41.484347+0000","last_active":"2024-03-18T18:25:41.484347+0000","last_peered":"2024-03-18T18:25:41.484347+0000","last_clean":"2024-03-18T18:25:41.484347+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:41.484347+0000","last_undegraded":"2024-03-18T18:25:41.484347+0000","last_fullsized":"2024-03-18T18:25:41.484347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2296","last_scrub_stamp":"2024-03-18T18:25:41.483991+0000","last_deep_scrub":"56'2296","last_deep_scrub_stamp":"2024-03-18T18:25:41.483991+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.483991+0000","objects_scrubbed":3,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.106164+0000","scrub_duration":0.040176058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1144,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"56'3706","reported_seq":3087,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:52.814394+0000","last_change":"2024-03-18T18:25:52.814394+0000","last_active":"2024-03-18T18:25:52.814394+0000","last_peered":"2024-03-18T18:25:52.814394+0000","last_clean":"2024-03-18T18:25:52.814394+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:52.814394+0000","last_undegraded":"2024-03-18T18:25:52.814394+0000","last_fullsized":"2024-03-18T18:25:52.814394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3706","last_scrub_stamp":"2024-03-18T18:25:52.814198+0000","last_deep_scrub":"56'3706","last_deep_scrub_stamp":"2024-03-18T18:25:52.814198+0000","last_clean_scrub_stamp":"2024-03-18T18:25:52.814198+0000","objects_scrubbed":2,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:59:43.699712+0000","scrub_duration":0.039535882000000001,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"56'2697","reported_seq":2761,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:00.070619+0000","last_change":"2024-03-18T18:26:00.070619+0000","last_active":"2024-03-18T18:26:00.070619+0000","last_peered":"2024-03-18T18:26:00.070619+0000","last_clean":"2024-03-18T18:26:00.070619+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:26:00.070619+0000","last_undegraded":"2024-03-18T18:26:00.070619+0000","last_fullsized":"2024-03-18T18:26:00.070619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2697","last_scrub_stamp":"2024-03-18T18:26:00.070324+0000","last_deep_scrub":"56'2697","last_deep_scrub_stamp":"2024-03-18T18:26:00.070324+0000","last_clean_scrub_stamp":"2024-03-18T18:26:00.070324+0000","objects_scrubbed":3,"log_size":2697,"log_dups_size":0,"ondisk_log_size":2697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:14:02.648229+0000","scrub_duration":0.042248144000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'3879","reported_seq":3253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:50.521236+0000","last_change":"2024-03-18T18:25:50.521386+0000","last_active":"2024-03-18T18:25:50.521236+0000","last_peered":"2024-03-18T18:25:50.521236+0000","last_clean":"2024-03-18T18:25:50.521236+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:50.521236+0000","last_undegraded":"2024-03-18T18:25:50.521236+0000","last_fullsized":"2024-03-18T18:25:50.521236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3879","last_scrub_stamp":"2024-03-18T18:25:50.521213+0000","last_deep_scrub":"56'3879","last_deep_scrub_stamp":"2024-03-18T18:25:50.521213+0000","last_clean_scrub_stamp":"2024-03-18T18:25:50.521213+0000","objects_scrubbed":3,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:25.096813+0000","scrub_duration":0.051826733,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"56'3875","reported_seq":3939,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.986624+0000","last_change":"2024-03-18T18:25:59.986799+0000","last_active":"2024-03-18T18:25:59.986624+0000","last_peered":"2024-03-18T18:25:59.986624+0000","last_clean":"2024-03-18T18:25:59.986624+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:59.986624+0000","last_undegraded":"2024-03-18T18:25:59.986624+0000","last_fullsized":"2024-03-18T18:25:59.986624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3875","last_scrub_stamp":"2024-03-18T18:25:59.986592+0000","last_deep_scrub":"56'3875","last_deep_scrub_stamp":"2024-03-18T18:25:59.986592+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.986592+0000","objects_scrubbed":6,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:24:59.170445+0000","scrub_duration":0.058570773999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3979,"num_write_kb":30875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"54'3911","reported_seq":3212,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.145839+0000","last_change":"2024-03-18T18:25:29.054617+0000","last_active":"2024-03-18T18:25:41.145839+0000","last_peered":"2024-03-18T18:25:41.145839+0000","last_clean":"2024-03-18T18:25:41.145839+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:25:41.145839+0000","last_undegraded":"2024-03-18T18:25:41.145839+0000","last_fullsized":"2024-03-18T18:25:41.145839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"56'2798","reported_seq":2862,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:42.717588+0000","last_change":"2024-03-18T18:25:42.717894+0000","last_active":"2024-03-18T18:25:42.717588+0000","last_peered":"2024-03-18T18:25:42.717588+0000","last_clean":"2024-03-18T18:25:42.717588+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:42.717588+0000","last_undegraded":"2024-03-18T18:25:42.717588+0000","last_fullsized":"2024-03-18T18:25:42.717588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2798","last_scrub_stamp":"2024-03-18T18:25:42.717503+0000","last_deep_scrub":"56'2798","last_deep_scrub_stamp":"2024-03-18T18:25:42.717503+0000","last_clean_scrub_stamp":"2024-03-18T18:25:42.717503+0000","objects_scrubbed":4,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:35:36.581172+0000","scrub_duration":0.050648071000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5500,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"56'3873","reported_seq":3198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:49.807272+0000","last_change":"2024-03-18T18:25:49.807385+0000","last_active":"2024-03-18T18:25:49.807272+0000","last_peered":"2024-03-18T18:25:49.807272+0000","last_clean":"2024-03-18T18:25:49.807272+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:49.807272+0000","last_undegraded":"2024-03-18T18:25:49.807272+0000","last_fullsized":"2024-03-18T18:25:49.807272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3873","last_scrub_stamp":"2024-03-18T18:25:49.807250+0000","last_deep_scrub":"56'3873","last_deep_scrub_stamp":"2024-03-18T18:25:49.807250+0000","last_clean_scrub_stamp":"2024-03-18T18:25:49.807250+0000","objects_scrubbed":3,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:08:26.538859+0000","scrub_duration":0.047405282999999999,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"56'150","reported_seq":214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:01.498268+0000","last_change":"2024-03-18T18:26:01.498448+0000","last_active":"2024-03-18T18:26:01.498268+0000","last_peered":"2024-03-18T18:26:01.498268+0000","last_clean":"2024-03-18T18:26:01.498268+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:26:01.498268+0000","last_undegraded":"2024-03-18T18:26:01.498268+0000","last_fullsized":"2024-03-18T18:26:01.498268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'150","last_scrub_stamp":"2024-03-18T18:26:01.498242+0000","last_deep_scrub":"56'150","last_deep_scrub_stamp":"2024-03-18T18:26:01.498242+0000","last_clean_scrub_stamp":"2024-03-18T18:26:01.498242+0000","objects_scrubbed":2,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:08.639424+0000","scrub_duration":0.016983127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3420,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:18.370365+0000","last_change":"2024-03-18T18:26:18.370486+0000","last_active":"2024-03-18T18:26:18.370365+0000","last_peered":"2024-03-18T18:26:18.370365+0000","last_clean":"2024-03-18T18:26:18.370365+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:26:18.370365+0000","last_undegraded":"2024-03-18T18:26:18.370365+0000","last_fullsized":"2024-03-18T18:26:18.370365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4078","last_scrub_stamp":"2024-03-18T18:26:18.370343+0000","last_deep_scrub":"54'4078","last_deep_scrub_stamp":"2024-03-18T18:26:18.370343+0000","last_clean_scrub_stamp":"2024-03-18T18:26:18.370343+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:51.906097+0000","scrub_duration":0.036888690000000002,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"56'1129","reported_seq":1193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:44.808254+0000","last_change":"2024-03-18T18:25:44.808524+0000","last_active":"2024-03-18T18:25:44.808254+0000","last_peered":"2024-03-18T18:25:44.808254+0000","last_clean":"2024-03-18T18:25:44.808254+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:44.808254+0000","last_undegraded":"2024-03-18T18:25:44.808254+0000","last_fullsized":"2024-03-18T18:25:44.808254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1129","last_scrub_stamp":"2024-03-18T18:25:44.808198+0000","last_deep_scrub":"56'1129","last_deep_scrub_stamp":"2024-03-18T18:25:44.808198+0000","last_clean_scrub_stamp":"2024-03-18T18:25:44.808198+0000","objects_scrubbed":2,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:59.462515+0000","scrub_duration":0.037470452000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"56'3650","reported_seq":2987,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.060898+0000","last_change":"2024-03-18T18:26:06.061173+0000","last_active":"2024-03-18T18:26:06.060898+0000","last_peered":"2024-03-18T18:26:06.060898+0000","last_clean":"2024-03-18T18:26:06.060898+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:26:06.060898+0000","last_undegraded":"2024-03-18T18:26:06.060898+0000","last_fullsized":"2024-03-18T18:26:06.060898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3650","last_scrub_stamp":"2024-03-18T18:26:06.060873+0000","last_deep_scrub":"56'3650","last_deep_scrub_stamp":"2024-03-18T18:26:06.060873+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.060873+0000","objects_scrubbed":1,"log_size":3650,"log_dups_size":0,"ondisk_log_size":3650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:14:08.638778+0000","scrub_duration":0.042544116,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"56'1557","reported_seq":1621,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.009218+0000","last_change":"2024-03-18T18:25:40.009370+0000","last_active":"2024-03-18T18:25:40.009218+0000","last_peered":"2024-03-18T18:25:40.009218+0000","last_clean":"2024-03-18T18:25:40.009218+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:40.009218+0000","last_undegraded":"2024-03-18T18:25:40.009218+0000","last_fullsized":"2024-03-18T18:25:40.009218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1557","last_scrub_stamp":"2024-03-18T18:25:40.009192+0000","last_deep_scrub":"56'1557","last_deep_scrub_stamp":"2024-03-18T18:25:40.009192+0000","last_clean_scrub_stamp":"2024-03-18T18:25:40.009192+0000","objects_scrubbed":6,"log_size":1557,"log_dups_size":0,"ondisk_log_size":1557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:16.766526+0000","scrub_duration":0.020714032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"54'4133","reported_seq":3370,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.750837+0000","last_change":"2024-03-18T18:25:29.051925+0000","last_active":"2024-03-18T18:25:37.750837+0000","last_peered":"2024-03-18T18:25:37.750837+0000","last_clean":"2024-03-18T18:25:37.750837+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:25:37.750837+0000","last_undegraded":"2024-03-18T18:25:37.750837+0000","last_fullsized":"2024-03-18T18:25:37.750837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4133,"log_dups_size":0,"ondisk_log_size":4133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"56'1390","reported_seq":1454,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.490628+0000","last_change":"2024-03-18T18:25:43.490805+0000","last_active":"2024-03-18T18:25:43.490628+0000","last_peered":"2024-03-18T18:25:43.490628+0000","last_clean":"2024-03-18T18:25:43.490628+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:43.490628+0000","last_undegraded":"2024-03-18T18:25:43.490628+0000","last_fullsized":"2024-03-18T18:25:43.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1390","last_scrub_stamp":"2024-03-18T18:25:43.490608+0000","last_deep_scrub":"56'1390","last_deep_scrub_stamp":"2024-03-18T18:25:43.490608+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.490608+0000","objects_scrubbed":2,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:38.146924+0000","scrub_duration":0.044349553999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"56'3702","reported_seq":3058,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.208364+0000","last_change":"2024-03-18T18:25:41.208536+0000","last_active":"2024-03-18T18:25:41.208364+0000","last_peered":"2024-03-18T18:25:41.208364+0000","last_clean":"2024-03-18T18:25:41.208364+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:41.208364+0000","last_undegraded":"2024-03-18T18:25:41.208364+0000","last_fullsized":"2024-03-18T18:25:41.208364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3702","last_scrub_stamp":"2024-03-18T18:25:41.208326+0000","last_deep_scrub":"56'3702","last_deep_scrub_stamp":"2024-03-18T18:25:41.208326+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.208326+0000","objects_scrubbed":2,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:42.057439+0000","scrub_duration":0.048613747999999998,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"56'1378","reported_seq":1442,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.908708+0000","last_change":"2024-03-18T18:25:43.908832+0000","last_active":"2024-03-18T18:25:43.908708+0000","last_peered":"2024-03-18T18:25:43.908708+0000","last_clean":"2024-03-18T18:25:43.908708+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:43.908708+0000","last_undegraded":"2024-03-18T18:25:43.908708+0000","last_fullsized":"2024-03-18T18:25:43.908708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1378","last_scrub_stamp":"2024-03-18T18:25:43.908685+0000","last_deep_scrub":"56'1378","last_deep_scrub_stamp":"2024-03-18T18:25:43.908685+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.908685+0000","objects_scrubbed":1,"log_size":1378,"log_dups_size":0,"ondisk_log_size":1378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:52.530858+0000","scrub_duration":0.016835227000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"56'4068","reported_seq":3369,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.043897+0000","last_change":"2024-03-18T18:26:06.044430+0000","last_active":"2024-03-18T18:26:06.043897+0000","last_peered":"2024-03-18T18:26:06.043897+0000","last_clean":"2024-03-18T18:26:06.043897+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:26:06.043897+0000","last_undegraded":"2024-03-18T18:26:06.043897+0000","last_fullsized":"2024-03-18T18:26:06.043897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4068","last_scrub_stamp":"2024-03-18T18:26:06.043844+0000","last_deep_scrub":"56'4068","last_deep_scrub_stamp":"2024-03-18T18:26:06.043844+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.043844+0000","objects_scrubbed":3,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:40.265708+0000","scrub_duration":0.034103359999999999,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"56'4631","reported_seq":4695,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:57.002010+0000","last_change":"2024-03-18T18:25:57.002379+0000","last_active":"2024-03-18T18:25:57.002010+0000","last_peered":"2024-03-18T18:25:57.002010+0000","last_clean":"2024-03-18T18:25:57.002010+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:57.002010+0000","last_undegraded":"2024-03-18T18:25:57.002010+0000","last_fullsized":"2024-03-18T18:25:57.002010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4631","last_scrub_stamp":"2024-03-18T18:25:57.001949+0000","last_deep_scrub":"56'4631","last_deep_scrub_stamp":"2024-03-18T18:25:57.001949+0000","last_clean_scrub_stamp":"2024-03-18T18:25:57.001949+0000","objects_scrubbed":2,"log_size":4631,"log_dups_size":0,"ondisk_log_size":4631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:31.223814+0000","scrub_duration":0.049250552000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3739","reported_seq":3075,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:20.582271+0000","last_change":"2024-03-18T18:26:20.582403+0000","last_active":"2024-03-18T18:26:20.582271+0000","last_peered":"2024-03-18T18:26:20.582271+0000","last_clean":"2024-03-18T18:26:20.582271+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:26:20.582271+0000","last_undegraded":"2024-03-18T18:26:20.582271+0000","last_fullsized":"2024-03-18T18:26:20.582271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3739","last_scrub_stamp":"2024-03-18T18:26:20.582247+0000","last_deep_scrub":"54'3739","last_deep_scrub_stamp":"2024-03-18T18:26:20.582247+0000","last_clean_scrub_stamp":"2024-03-18T18:26:20.582247+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:19:50.468023+0000","scrub_duration":0.040383333,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"56'5041","reported_seq":5105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.017168+0000","last_change":"2024-03-18T18:25:46.017304+0000","last_active":"2024-03-18T18:25:46.017168+0000","last_peered":"2024-03-18T18:25:46.017168+0000","last_clean":"2024-03-18T18:25:46.017168+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:46.017168+0000","last_undegraded":"2024-03-18T18:25:46.017168+0000","last_fullsized":"2024-03-18T18:25:46.017168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5041","last_scrub_stamp":"2024-03-18T18:25:46.017144+0000","last_deep_scrub":"56'5041","last_deep_scrub_stamp":"2024-03-18T18:25:46.017144+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.017144+0000","objects_scrubbed":7,"log_size":5041,"log_dups_size":0,"ondisk_log_size":5041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:02:01.460825+0000","scrub_duration":0.095345580999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"54'3518","reported_seq":2899,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.751291+0000","last_change":"2024-03-18T18:25:29.055382+0000","last_active":"2024-03-18T18:25:37.751291+0000","last_peered":"2024-03-18T18:25:37.751291+0000","last_clean":"2024-03-18T18:25:37.751291+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:25:37.751291+0000","last_undegraded":"2024-03-18T18:25:37.751291+0000","last_fullsized":"2024-03-18T18:25:37.751291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":3518,"log_dups_size":0,"ondisk_log_size":3518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"56'119","reported_seq":220,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:56.012960+0000","last_change":"2024-03-18T18:25:56.013101+0000","last_active":"2024-03-18T18:25:56.012960+0000","last_peered":"2024-03-18T18:25:56.012960+0000","last_clean":"2024-03-18T18:25:56.012960+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:56.012960+0000","last_undegraded":"2024-03-18T18:25:56.012960+0000","last_fullsized":"2024-03-18T18:25:56.012960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-03-18T18:25:56.012932+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-03-18T18:25:56.012932+0000","last_clean_scrub_stamp":"2024-03-18T18:25:56.012932+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:03.154114+0000","scrub_duration":0.016100778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"56'1923","reported_seq":1988,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.496148+0000","last_change":"2024-03-18T18:25:46.496148+0000","last_active":"2024-03-18T18:25:46.496148+0000","last_peered":"2024-03-18T18:25:46.496148+0000","last_clean":"2024-03-18T18:25:46.496148+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:46.496148+0000","last_undegraded":"2024-03-18T18:25:46.496148+0000","last_fullsized":"2024-03-18T18:25:46.496148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1923","last_scrub_stamp":"2024-03-18T18:25:46.495988+0000","last_deep_scrub":"56'1923","last_deep_scrub_stamp":"2024-03-18T18:25:46.495988+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.495988+0000","objects_scrubbed":3,"log_size":1923,"log_dups_size":0,"ondisk_log_size":1923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:01.150305+0000","scrub_duration":0.039538838999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:55.069417+0000","last_change":"2024-03-18T18:25:55.069555+0000","last_active":"2024-03-18T18:25:55.069417+0000","last_peered":"2024-03-18T18:25:55.069417+0000","last_clean":"2024-03-18T18:25:55.069417+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:55.069417+0000","last_undegraded":"2024-03-18T18:25:55.069417+0000","last_fullsized":"2024-03-18T18:25:55.069417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3732","last_scrub_stamp":"2024-03-18T18:25:55.069397+0000","last_deep_scrub":"54'3732","last_deep_scrub_stamp":"2024-03-18T18:25:55.069397+0000","last_clean_scrub_stamp":"2024-03-18T18:25:55.069397+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:59:45.954910+0000","scrub_duration":0.034961982000000003,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"56'4978","reported_seq":5043,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.167805+0000","last_change":"2024-03-18T18:25:59.167976+0000","last_active":"2024-03-18T18:25:59.167805+0000","last_peered":"2024-03-18T18:25:59.167805+0000","last_clean":"2024-03-18T18:25:59.167805+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:59.167805+0000","last_undegraded":"2024-03-18T18:25:59.167805+0000","last_fullsized":"2024-03-18T18:25:59.167805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4978","last_scrub_stamp":"2024-03-18T18:25:59.167781+0000","last_deep_scrub":"56'4978","last_deep_scrub_stamp":"2024-03-18T18:25:59.167781+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.167781+0000","objects_scrubbed":3,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:33.389646+0000","scrub_duration":0.048284953999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2947,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.766358+0000","last_change":"2024-03-18T18:25:54.766577+0000","last_active":"2024-03-18T18:25:54.766358+0000","last_peered":"2024-03-18T18:25:54.766358+0000","last_clean":"2024-03-18T18:25:54.766358+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:54.766358+0000","last_undegraded":"2024-03-18T18:25:54.766358+0000","last_fullsized":"2024-03-18T18:25:54.766358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3549","last_scrub_stamp":"2024-03-18T18:25:54.766331+0000","last_deep_scrub":"54'3549","last_deep_scrub_stamp":"2024-03-18T18:25:54.766331+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.766331+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:13.460331+0000","scrub_duration":0.038148003999999999,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"56'2670","reported_seq":3275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.951311+0000","last_change":"2024-03-18T18:25:41.951311+0000","last_active":"2024-03-18T18:25:41.951311+0000","last_peered":"2024-03-18T18:25:41.951311+0000","last_clean":"2024-03-18T18:25:41.951311+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:41.951311+0000","last_undegraded":"2024-03-18T18:25:41.951311+0000","last_fullsized":"2024-03-18T18:25:41.951311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2670","last_scrub_stamp":"2024-03-18T18:25:41.950936+0000","last_deep_scrub":"56'2670","last_deep_scrub_stamp":"2024-03-18T18:25:41.950936+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.950936+0000","objects_scrubbed":2,"log_size":2670,"log_dups_size":0,"ondisk_log_size":2670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:16.526536+0000","scrub_duration":0.038474542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"56'4237","reported_seq":3498,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.108085+0000","last_change":"2024-03-18T18:26:04.108204+0000","last_active":"2024-03-18T18:26:04.108085+0000","last_peered":"2024-03-18T18:26:04.108085+0000","last_clean":"2024-03-18T18:26:04.108085+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:26:04.108085+0000","last_undegraded":"2024-03-18T18:26:04.108085+0000","last_fullsized":"2024-03-18T18:26:04.108085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4237","last_scrub_stamp":"2024-03-18T18:26:04.108063+0000","last_deep_scrub":"56'4237","last_deep_scrub_stamp":"2024-03-18T18:26:04.108063+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.108063+0000","objects_scrubbed":2,"log_size":4237,"log_dups_size":0,"ondisk_log_size":4237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:50:56.604412+0000","scrub_duration":0.031818854000000001,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"56'5926","reported_seq":5991,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:48.541126+0000","last_change":"2024-03-18T18:25:48.541126+0000","last_active":"2024-03-18T18:25:48.541126+0000","last_peered":"2024-03-18T18:25:48.541126+0000","last_clean":"2024-03-18T18:25:48.541126+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:48.541126+0000","last_undegraded":"2024-03-18T18:25:48.541126+0000","last_fullsized":"2024-03-18T18:25:48.541126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5926","last_scrub_stamp":"2024-03-18T18:25:48.540811+0000","last_deep_scrub":"56'5926","last_deep_scrub_stamp":"2024-03-18T18:25:48.540811+0000","last_clean_scrub_stamp":"2024-03-18T18:25:48.540811+0000","objects_scrubbed":6,"log_size":5926,"log_dups_size":0,"ondisk_log_size":5926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:28:42.884022+0000","scrub_duration":0.085163540999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3976","reported_seq":3265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.457689+0000","last_change":"2024-03-18T18:25:54.457689+0000","last_active":"2024-03-18T18:25:54.457689+0000","last_peered":"2024-03-18T18:25:54.457689+0000","last_clean":"2024-03-18T18:25:54.457689+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:54.457689+0000","last_undegraded":"2024-03-18T18:25:54.457689+0000","last_fullsized":"2024-03-18T18:25:54.457689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3976","last_scrub_stamp":"2024-03-18T18:25:54.457559+0000","last_deep_scrub":"54'3976","last_deep_scrub_stamp":"2024-03-18T18:25:54.457559+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.457559+0000","objects_scrubbed":0,"log_size":3976,"log_dups_size":0,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:02:09.901240+0000","scrub_duration":0.040947814999999999,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"56'956","reported_seq":1021,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.069999+0000","last_change":"2024-03-18T18:25:41.069999+0000","last_active":"2024-03-18T18:25:41.069999+0000","last_peered":"2024-03-18T18:25:41.069999+0000","last_clean":"2024-03-18T18:25:41.069999+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:41.069999+0000","last_undegraded":"2024-03-18T18:25:41.069999+0000","last_fullsized":"2024-03-18T18:25:41.069999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'956","last_scrub_stamp":"2024-03-18T18:25:41.069763+0000","last_deep_scrub":"56'956","last_deep_scrub_stamp":"2024-03-18T18:25:41.069763+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.069763+0000","objects_scrubbed":3,"log_size":956,"log_dups_size":0,"ondisk_log_size":956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:28:35.412974+0000","scrub_duration":0.031375185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"56'3618","reported_seq":3025,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.469717+0000","last_change":"2024-03-18T18:26:04.470040+0000","last_active":"2024-03-18T18:26:04.469717+0000","last_peered":"2024-03-18T18:26:04.469717+0000","last_clean":"2024-03-18T18:26:04.469717+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:26:04.469717+0000","last_undegraded":"2024-03-18T18:26:04.469717+0000","last_fullsized":"2024-03-18T18:26:04.469717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3618","last_scrub_stamp":"2024-03-18T18:26:04.469643+0000","last_deep_scrub":"56'3618","last_deep_scrub_stamp":"2024-03-18T18:26:04.469643+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.469643+0000","objects_scrubbed":3,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:38.691508+0000","scrub_duration":0.055161114999999997,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"56'3705","reported_seq":3770,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.139105+0000","last_change":"2024-03-18T18:26:06.139229+0000","last_active":"2024-03-18T18:26:06.139105+0000","last_peered":"2024-03-18T18:26:06.139105+0000","last_clean":"2024-03-18T18:26:06.139105+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:26:06.139105+0000","last_undegraded":"2024-03-18T18:26:06.139105+0000","last_fullsized":"2024-03-18T18:26:06.139105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3705","last_scrub_stamp":"2024-03-18T18:26:06.139083+0000","last_deep_scrub":"56'3705","last_deep_scrub_stamp":"2024-03-18T18:26:06.139083+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.139083+0000","objects_scrubbed":1,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:50:58.635432+0000","scrub_duration":0.032071388999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:09.144752+0000","last_change":"2024-03-18T18:26:09.144900+0000","last_active":"2024-03-18T18:26:09.144752+0000","last_peered":"2024-03-18T18:26:09.144752+0000","last_clean":"2024-03-18T18:26:09.144752+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:26:09.144752+0000","last_undegraded":"2024-03-18T18:26:09.144752+0000","last_fullsized":"2024-03-18T18:26:09.144752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3803","last_scrub_stamp":"2024-03-18T18:26:09.144731+0000","last_deep_scrub":"54'3803","last_deep_scrub_stamp":"2024-03-18T18:26:09.144731+0000","last_clean_scrub_stamp":"2024-03-18T18:26:09.144731+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:11.128772+0000","scrub_duration":0.032417933000000003,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"56'2149","reported_seq":2213,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.106012+0000","last_change":"2024-03-18T18:25:54.106218+0000","last_active":"2024-03-18T18:25:54.106012+0000","last_peered":"2024-03-18T18:25:54.106012+0000","last_clean":"2024-03-18T18:25:54.106012+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:54.106012+0000","last_undegraded":"2024-03-18T18:25:54.106012+0000","last_fullsized":"2024-03-18T18:25:54.106012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2149","last_scrub_stamp":"2024-03-18T18:25:54.105980+0000","last_deep_scrub":"56'2149","last_deep_scrub_stamp":"2024-03-18T18:25:54.105980+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.105980+0000","objects_scrubbed":5,"log_size":2149,"log_dups_size":0,"ondisk_log_size":2149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:01.247163+0000","scrub_duration":0.135641664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2826,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.120486+0000","last_change":"2024-03-18T18:26:11.120619+0000","last_active":"2024-03-18T18:26:11.120486+0000","last_peered":"2024-03-18T18:26:11.120486+0000","last_clean":"2024-03-18T18:26:11.120486+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:26:11.120486+0000","last_undegraded":"2024-03-18T18:26:11.120486+0000","last_fullsized":"2024-03-18T18:26:11.120486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3397","last_scrub_stamp":"2024-03-18T18:26:11.120463+0000","last_deep_scrub":"54'3397","last_deep_scrub_stamp":"2024-03-18T18:26:11.120463+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.120463+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:22.172623+0000","scrub_duration":0.028029561000000001,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"56'1822","reported_seq":1886,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.832517+0000","last_change":"2024-03-18T18:25:41.832792+0000","last_active":"2024-03-18T18:25:41.832517+0000","last_peered":"2024-03-18T18:25:41.832517+0000","last_clean":"2024-03-18T18:25:41.832517+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:41.832517+0000","last_undegraded":"2024-03-18T18:25:41.832517+0000","last_fullsized":"2024-03-18T18:25:41.832517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1822","last_scrub_stamp":"2024-03-18T18:25:41.832464+0000","last_deep_scrub":"56'1822","last_deep_scrub_stamp":"2024-03-18T18:25:41.832464+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.832464+0000","objects_scrubbed":2,"log_size":1822,"log_dups_size":0,"ondisk_log_size":1822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.454637+0000","scrub_duration":0.030830237999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"56'3545","reported_seq":2962,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:50.806420+0000","last_change":"2024-03-18T18:25:50.806580+0000","last_active":"2024-03-18T18:25:50.806420+0000","last_peered":"2024-03-18T18:25:50.806420+0000","last_clean":"2024-03-18T18:25:50.806420+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:50.806420+0000","last_undegraded":"2024-03-18T18:25:50.806420+0000","last_fullsized":"2024-03-18T18:25:50.806420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3545","last_scrub_stamp":"2024-03-18T18:25:50.806396+0000","last_deep_scrub":"56'3545","last_deep_scrub_stamp":"2024-03-18T18:25:50.806396+0000","last_clean_scrub_stamp":"2024-03-18T18:25:50.806396+0000","objects_scrubbed":5,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:11.869852+0000","scrub_duration":0.050638803000000003,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"56'1603","reported_seq":1667,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:17.309504+0000","last_change":"2024-03-18T18:26:17.309927+0000","last_active":"2024-03-18T18:26:17.309504+0000","last_peered":"2024-03-18T18:26:17.309504+0000","last_clean":"2024-03-18T18:26:17.309504+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:26:17.309504+0000","last_undegraded":"2024-03-18T18:26:17.309504+0000","last_fullsized":"2024-03-18T18:26:17.309504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1603","last_scrub_stamp":"2024-03-18T18:26:17.309379+0000","last_deep_scrub":"56'1603","last_deep_scrub_stamp":"2024-03-18T18:26:17.309379+0000","last_clean_scrub_stamp":"2024-03-18T18:26:17.309379+0000","objects_scrubbed":1,"log_size":1603,"log_dups_size":0,"ondisk_log_size":1603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:15:10.477824+0000","scrub_duration":0.025857398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"56'3744","reported_seq":3051,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:49.482455+0000","last_change":"2024-03-18T18:25:49.482819+0000","last_active":"2024-03-18T18:25:49.482455+0000","last_peered":"2024-03-18T18:25:49.482455+0000","last_clean":"2024-03-18T18:25:49.482455+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:49.482455+0000","last_undegraded":"2024-03-18T18:25:49.482455+0000","last_fullsized":"2024-03-18T18:25:49.482455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3744","last_scrub_stamp":"2024-03-18T18:25:49.482375+0000","last_deep_scrub":"56'3744","last_deep_scrub_stamp":"2024-03-18T18:25:49.482375+0000","last_clean_scrub_stamp":"2024-03-18T18:25:49.482375+0000","objects_scrubbed":1,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:26.239708+0000","scrub_duration":0.047960088999999997,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'2480","reported_seq":2544,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.116348+0000","last_change":"2024-03-18T18:25:40.116493+0000","last_active":"2024-03-18T18:25:40.116348+0000","last_peered":"2024-03-18T18:25:40.116348+0000","last_clean":"2024-03-18T18:25:40.116348+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:40.116348+0000","last_undegraded":"2024-03-18T18:25:40.116348+0000","last_fullsized":"2024-03-18T18:25:40.116348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2480","last_scrub_stamp":"2024-03-18T18:25:40.116301+0000","last_deep_scrub":"56'2480","last_deep_scrub_stamp":"2024-03-18T18:25:40.116301+0000","last_clean_scrub_stamp":"2024-03-18T18:25:40.116301+0000","objects_scrubbed":2,"log_size":2480,"log_dups_size":0,"ondisk_log_size":2480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:33:19.069144+0000","scrub_duration":0.043506561999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"56'4000","reported_seq":3341,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:51.142475+0000","last_change":"2024-03-18T18:25:51.142616+0000","last_active":"2024-03-18T18:25:51.142475+0000","last_peered":"2024-03-18T18:25:51.142475+0000","last_clean":"2024-03-18T18:25:51.142475+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:51.142475+0000","last_undegraded":"2024-03-18T18:25:51.142475+0000","last_fullsized":"2024-03-18T18:25:51.142475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4000","last_scrub_stamp":"2024-03-18T18:25:51.142454+0000","last_deep_scrub":"56'4000","last_deep_scrub_stamp":"2024-03-18T18:25:51.142454+0000","last_clean_scrub_stamp":"2024-03-18T18:25:51.142454+0000","objects_scrubbed":7,"log_size":4000,"log_dups_size":0,"ondisk_log_size":4000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:08:27.874062+0000","scrub_duration":0.071429648999999998,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"56'2625","reported_seq":2689,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:39.120325+0000","last_change":"2024-03-18T18:25:39.120490+0000","last_active":"2024-03-18T18:25:39.120325+0000","last_peered":"2024-03-18T18:25:39.120325+0000","last_clean":"2024-03-18T18:25:39.120325+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:39.120325+0000","last_undegraded":"2024-03-18T18:25:39.120325+0000","last_fullsized":"2024-03-18T18:25:39.120325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2625","last_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_deep_scrub":"56'2625","last_deep_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_clean_scrub_stamp":"2024-03-18T18:25:39.120285+0000","objects_scrubbed":3,"log_size":2625,"log_dups_size":0,"ondisk_log_size":2625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:53.774603+0000","scrub_duration":0.046006920999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"56'3492","reported_seq":2928,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:13.077051+0000","last_change":"2024-03-18T18:26:13.077246+0000","last_active":"2024-03-18T18:26:13.077051+0000","last_peered":"2024-03-18T18:26:13.077051+0000","last_clean":"2024-03-18T18:26:13.077051+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:26:13.077051+0000","last_undegraded":"2024-03-18T18:26:13.077051+0000","last_fullsized":"2024-03-18T18:26:13.077051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3492","last_scrub_stamp":"2024-03-18T18:26:13.077012+0000","last_deep_scrub":"56'3492","last_deep_scrub_stamp":"2024-03-18T18:26:13.077012+0000","last_clean_scrub_stamp":"2024-03-18T18:26:13.077012+0000","objects_scrubbed":4,"log_size":3492,"log_dups_size":0,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:06:09.960717+0000","scrub_duration":0.044338466999999999,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"56'4486","reported_seq":4550,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:02.255649+0000","last_change":"2024-03-18T18:26:02.255788+0000","last_active":"2024-03-18T18:26:02.255649+0000","last_peered":"2024-03-18T18:26:02.255649+0000","last_clean":"2024-03-18T18:26:02.255649+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:26:02.255649+0000","last_undegraded":"2024-03-18T18:26:02.255649+0000","last_fullsized":"2024-03-18T18:26:02.255649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4486","last_scrub_stamp":"2024-03-18T18:26:02.255623+0000","last_deep_scrub":"56'4486","last_deep_scrub_stamp":"2024-03-18T18:26:02.255623+0000","last_clean_scrub_stamp":"2024-03-18T18:26:02.255623+0000","objects_scrubbed":3,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:27.313755+0000","scrub_duration":0.058791388999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":402,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"56'3777","reported_seq":3148,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.057707+0000","last_change":"2024-03-18T18:26:04.057819+0000","last_active":"2024-03-18T18:26:04.057707+0000","last_peered":"2024-03-18T18:26:04.057707+0000","last_clean":"2024-03-18T18:26:04.057707+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:26:04.057707+0000","last_undegraded":"2024-03-18T18:26:04.057707+0000","last_fullsized":"2024-03-18T18:26:04.057707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3777","last_scrub_stamp":"2024-03-18T18:26:04.057685+0000","last_deep_scrub":"56'3777","last_deep_scrub_stamp":"2024-03-18T18:26:04.057685+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.057685+0000","objects_scrubbed":1,"log_size":3777,"log_dups_size":0,"ondisk_log_size":3777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:38.279550+0000","scrub_duration":0.037046915999999999,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"56'3711","reported_seq":3134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.487655+0000","last_change":"2024-03-18T18:26:11.487809+0000","last_active":"2024-03-18T18:26:11.487655+0000","last_peered":"2024-03-18T18:26:11.487655+0000","last_clean":"2024-03-18T18:26:11.487655+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:26:11.487655+0000","last_undegraded":"2024-03-18T18:26:11.487655+0000","last_fullsized":"2024-03-18T18:26:11.487655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3711","last_scrub_stamp":"2024-03-18T18:26:11.487624+0000","last_deep_scrub":"56'3711","last_deep_scrub_stamp":"2024-03-18T18:26:11.487624+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.487624+0000","objects_scrubbed":1,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:51:21.988156+0000","scrub_duration":0.051621667000000003,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"56'1390","reported_seq":1453,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.243471+0000","last_change":"2024-03-18T18:26:11.243680+0000","last_active":"2024-03-18T18:26:11.243471+0000","last_peered":"2024-03-18T18:26:11.243471+0000","last_clean":"2024-03-18T18:26:11.243471+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:26:11.243471+0000","last_undegraded":"2024-03-18T18:26:11.243471+0000","last_fullsized":"2024-03-18T18:26:11.243471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1390","last_scrub_stamp":"2024-03-18T18:26:11.243437+0000","last_deep_scrub":"56'1390","last_deep_scrub_stamp":"2024-03-18T18:26:11.243437+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.243437+0000","objects_scrubbed":3,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:13.227478+0000","scrub_duration":0.034684624999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4103","reported_seq":3381,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:37.821222+0000","last_change":"2024-03-18T18:25:29.032671+0000","last_active":"2024-03-18T18:25:37.821222+0000","last_peered":"2024-03-18T18:25:37.821222+0000","last_clean":"2024-03-18T18:25:37.821222+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:25:37.821222+0000","last_undegraded":"2024-03-18T18:25:37.821222+0000","last_fullsized":"2024-03-18T18:25:37.821222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T18:09:12.416688+0000","last_clean_scrub_stamp":"2024-03-18T18:09:12.416688+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"56'3533","reported_seq":3596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:12.281520+0000","last_change":"2024-03-18T18:26:12.281695+0000","last_active":"2024-03-18T18:26:12.281520+0000","last_peered":"2024-03-18T18:26:12.281520+0000","last_clean":"2024-03-18T18:26:12.281520+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:26:12.281520+0000","last_undegraded":"2024-03-18T18:26:12.281520+0000","last_fullsized":"2024-03-18T18:26:12.281520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3533","last_scrub_stamp":"2024-03-18T18:26:12.281491+0000","last_deep_scrub":"56'3533","last_deep_scrub_stamp":"2024-03-18T18:26:12.281491+0000","last_clean_scrub_stamp":"2024-03-18T18:26:12.281491+0000","objects_scrubbed":3,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:53:21.406695+0000","scrub_duration":0.049874452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"56'3442","reported_seq":2908,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.857648+0000","last_change":"2024-03-18T18:26:06.857820+0000","last_active":"2024-03-18T18:26:06.857648+0000","last_peered":"2024-03-18T18:26:06.857648+0000","last_clean":"2024-03-18T18:26:06.857648+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:26:06.857648+0000","last_undegraded":"2024-03-18T18:26:06.857648+0000","last_fullsized":"2024-03-18T18:26:06.857648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3442","last_scrub_stamp":"2024-03-18T18:26:06.857614+0000","last_deep_scrub":"56'3442","last_deep_scrub_stamp":"2024-03-18T18:26:06.857614+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.857614+0000","objects_scrubbed":1,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:17.909774+0000","scrub_duration":0.025994977999999998,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"56'3383","reported_seq":3448,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.104229+0000","last_change":"2024-03-18T18:25:47.104361+0000","last_active":"2024-03-18T18:25:47.104229+0000","last_peered":"2024-03-18T18:25:47.104229+0000","last_clean":"2024-03-18T18:25:47.104229+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:47.104229+0000","last_undegraded":"2024-03-18T18:25:47.104229+0000","last_fullsized":"2024-03-18T18:25:47.104229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3383","last_scrub_stamp":"2024-03-18T18:25:47.104205+0000","last_deep_scrub":"56'3383","last_deep_scrub_stamp":"2024-03-18T18:25:47.104205+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.104205+0000","objects_scrubbed":1,"log_size":3383,"log_dups_size":0,"ondisk_log_size":3383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:22.274913+0000","scrub_duration":0.034214560999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"56'3369","reported_seq":2800,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.003005+0000","last_change":"2024-03-18T18:26:04.003288+0000","last_active":"2024-03-18T18:26:04.003005+0000","last_peered":"2024-03-18T18:26:04.003005+0000","last_clean":"2024-03-18T18:26:04.003005+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:26:04.003005+0000","last_undegraded":"2024-03-18T18:26:04.003005+0000","last_fullsized":"2024-03-18T18:26:04.003005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3369","last_scrub_stamp":"2024-03-18T18:26:04.002951+0000","last_deep_scrub":"56'3369","last_deep_scrub_stamp":"2024-03-18T18:26:04.002951+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.002951+0000","objects_scrubbed":1,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:04:33.510782+0000","scrub_duration":0.044972314999999999,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"56'1531","reported_seq":1596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.745557+0000","last_change":"2024-03-18T18:25:43.745557+0000","last_active":"2024-03-18T18:25:43.745557+0000","last_peered":"2024-03-18T18:25:43.745557+0000","last_clean":"2024-03-18T18:25:43.745557+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:43.745557+0000","last_undegraded":"2024-03-18T18:25:43.745557+0000","last_fullsized":"2024-03-18T18:25:43.745557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1531","last_scrub_stamp":"2024-03-18T18:25:43.745375+0000","last_deep_scrub":"56'1531","last_deep_scrub_stamp":"2024-03-18T18:25:43.745375+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.745375+0000","objects_scrubbed":3,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:14:39.035373+0000","scrub_duration":0.036436525999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25222,"num_omap_keys":49,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":75039,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":242037,"ondisk_log_size":242037,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264990062,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88599,"num_write_kb":695434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35843,"num_omap_keys":70,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":530046976,"data_stored":529980124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85174,"ondisk_log_size":85174,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476948,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404728,"kb_used_data":66800,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967112,"statfs":{"total":96636764160,"available":96222322688,"internally_reserved":0,"allocated":68403200,"data_stored":68027641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.78800000000000003,"15min":0.73199999999999998},"min":{"1min":0.35599999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":13.092000000000001,"5min":13.092000000000001,"15min":13.092000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.087,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.3760000000000003,"5min":6.3760000000000003,"15min":6.3760000000000003},"last":0.745}]},{"osd":1,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.206,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.73999999999999999,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.5009999999999999},"last":1.016}]},{"osd":2,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69199999999999995,"15min":0.749},"min":{"1min":0.38900000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0880000000000001,"5min":1.115,"15min":1.3700000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1579999999999999,"5min":1.655,"15min":5.452},"last":0.94399999999999995}]},{"osd":3,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79700000000000004,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.82799999999999996,"15min":0.90000000000000002},"min":{"1min":0.44800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":2.5859999999999999},"last":1.117}]},{"osd":4,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71599999999999997,"15min":0.76100000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.296,"5min":1.726,"15min":1.726},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":2.085,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.78000000000000003,"15min":0.89100000000000001},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":4.1150000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.153,"5min":0.89700000000000002,"15min":0.95299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.968,"5min":1.968,"15min":4.2350000000000003},"last":1.1419999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":1.444,"5min":3.024,"15min":4.1840000000000002},"last":1.2},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.86799999999999999,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.476,"5min":3.1709999999999998,"15min":5.431},"last":1.167}]}]},{"osd":6,"up_from":16,"seq":68719476948,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367552,"kb_used_data":79736,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94004288,"statfs":{"total":96636764160,"available":96260390912,"internally_reserved":0,"allocated":81649664,"data_stored":81283602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.76200000000000001},"min":{"1min":0.28899999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.1060000000000001,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91800000000000004,"15min":0.84099999999999997},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.224,"5min":10.127000000000001,"15min":10.127000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.95099999999999996,"15min":0.81999999999999995},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0669999999999999,"5min":12.565,"15min":12.565},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.6499999999999999,"5min":1.087,"15min":0.88300000000000001},"min":{"1min":0.42199999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":16.579999999999998,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.93600000000000005}]},{"osd":2,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.79000000000000004,"15min":0.76400000000000001},"min":{"1min":0.38200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.6859999999999999,"5min":6.202,"15min":6.202},"last":1.046},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.90100000000000002,"15min":0.86899999999999999},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.157,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.98799999999999999,"15min":0.90200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":3.1320000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.87},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.35199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.113,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.80000000000000004}]},{"osd":4,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.33500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.208,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":1.004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.876,"15min":0.88300000000000001},"min":{"1min":0.45000000000000001,"5min":0.25,"15min":0.25},"max":{"1min":2.726,"5min":10.08,"15min":10.08},"last":0.745}]},{"osd":5,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.83199999999999996,"15min":0.95099999999999996},"min":{"1min":0.45100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":27.231000000000002},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.054,"15min":1.113},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.351,"5min":9.2509999999999994,"15min":27.478999999999999},"last":0.94899999999999995}]},{"osd":7,"last update":"Mon Mar 18 18:25:24 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98999999999999999,"15min":0.997},"min":{"1min":0.56999999999999995,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4570000000000001,"5min":10.182,"15min":10.182},"last":1.026},{"interface":"front","average":{"1min":1.02,"5min":0.86099999999999999,"15min":0.95499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.474,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.97099999999999997}]}]},{"osd":5,"up_from":16,"seq":68719476948,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514432,"kb_used_data":104312,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93857408,"statfs":{"total":96636764160,"available":96109985792,"internally_reserved":0,"allocated":106815488,"data_stored":106436602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.68799999999999994,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":2.073,"5min":2.073,"15min":3.6739999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":0.874,"15min":0.80800000000000005},"min":{"1min":0.57399999999999995,"5min":0.255,"15min":0.255},"max":{"1min":20.013000000000002,"5min":20.013000000000002,"15min":20.013000000000002},"last":0.83899999999999997}]},{"osd":1,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":7.2469999999999999,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.3160000000000001,"5min":0.85799999999999998,"15min":0.83199999999999996},"min":{"1min":0.48199999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.231,"5min":10.231,"15min":10.231},"last":0.88800000000000001}]},{"osd":2,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":0.876,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.041,"5min":12.041,"15min":12.041},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0580000000000001,"5min":0.81399999999999995,"15min":0.84699999999999998},"min":{"1min":0.57099999999999995,"5min":0.317,"15min":0.317},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.97599999999999998}]},{"osd":3,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6779999999999999,"5min":0.999,"15min":0.92600000000000005},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":16.183,"5min":16.183,"15min":16.183},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.125,"5min":0.89000000000000001,"15min":0.97199999999999998},"min":{"1min":0.61799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.0990000000000002,"5min":4.0990000000000002,"15min":13.678000000000001},"last":1.2}]},{"osd":4,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.71499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":3.548,"5min":3.548,"15min":3.548},"last":1.081},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.85799999999999998,"15min":0.90300000000000002},"min":{"1min":0.74399999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":1.27}]},{"osd":6,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":0.89000000000000001,"15min":0.93200000000000005},"min":{"1min":0.66300000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.89000000000000001,"15min":0.94499999999999995},"min":{"1min":0.64800000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":1.1699999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:25:29 2024","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.0860000000000001,"15min":1.0549999999999999},"min":{"1min":0.63500000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.766,"5min":12.766,"15min":12.766},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.716,"5min":1.091,"15min":1.083},"min":{"1min":0.77700000000000002,"5min":0.373,"15min":0.373},"max":{"1min":12.788,"5min":12.788,"15min":12.788},"last":1.409}]}]},{"osd":4,"up_from":16,"seq":68719476946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405736,"kb_used_data":53920,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93966104,"statfs":{"total":96636764160,"available":96221290496,"internally_reserved":0,"allocated":55214080,"data_stored":54845832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":360249799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.74199999999999999,"15min":0.71799999999999997},"min":{"1min":0.42599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.2629999999999999,"5min":2.536,"15min":2.536},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.65100000000000002,"15min":0.69499999999999995},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":1.2130000000000001,"5min":1.335,"15min":1.946},"last":0.81899999999999995}]},{"osd":1,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78600000000000003,"15min":0.75600000000000001},"min":{"1min":0.39000000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.081,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.754,"5min":0.92600000000000005,"15min":0.86199999999999999},"min":{"1min":0.498,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":17.451000000000001,"5min":17.451000000000001,"15min":17.451000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.48299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.202,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.81699999999999995,"15min":0.84999999999999998},"min":{"1min":0.55000000000000004,"5min":0.31,"15min":0.31},"max":{"1min":1.698,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.97299999999999998}]},{"osd":3,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.6799999999999999,"5min":2.681,"15min":2.681},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.008,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.631,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.78300000000000003,"15min":0.84699999999999998},"min":{"1min":0.52500000000000002,"5min":0.307,"15min":0.251},"max":{"1min":1.3069999999999999,"5min":2.613,"15min":4.7119999999999997},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.80400000000000005,"15min":0.88500000000000001},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":1.357,"5min":1.393,"15min":4.7480000000000002},"last":0.54100000000000004}]},{"osd":6,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.88100000000000001,"15min":0.91100000000000003},"min":{"1min":0.57699999999999996,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3540000000000001,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.099,"5min":0.90300000000000002,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.7749999999999999,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":1.1459999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.85999999999999999,"15min":0.93600000000000005},"min":{"1min":0.439,"5min":0.31,"15min":0.31},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":3.96},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1719999999999999,"5min":0.98299999999999998,"15min":1.028},"min":{"1min":0.67200000000000004,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.5509999999999999,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.175}]}]},{"osd":2,"up_from":15,"seq":64424509651,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260836,"kb_used_data":45212,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111004,"statfs":{"total":96636764160,"available":96369668096,"internally_reserved":0,"allocated":46297088,"data_stored":45936802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":0.80900000000000005,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.56100000000000005,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":2.7309999999999999,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.69099999999999995},"min":{"1min":0.53400000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.99299999999999999,"5min":1.1759999999999999,"15min":1.3149999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.028,"5min":1.1839999999999999,"15min":1.3},"last":0.89300000000000002}]},{"osd":3,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.84699999999999998,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.254,"15min":0.254},"max":{"1min":0.91000000000000003,"5min":12.778,"15min":12.778},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.94999999999999996,"15min":0.82499999999999996},"min":{"1min":0.55700000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.5780000000000001,"5min":12.84,"15min":12.84},"last":0.83399999999999996}]},{"osd":4,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.84699999999999998,"15min":0.85099999999999998},"min":{"1min":0.60399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.026,"5min":1.526,"15min":1.526},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.99199999999999999,"15min":0.95799999999999996},"min":{"1min":0.745,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2649999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":1.1499999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.095,"15min":1.0089999999999999},"min":{"1min":0.48499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.3939999999999999,"5min":12.807,"15min":12.807},"last":1.1899999999999999},{"interface":"front","average":{"1min":2.3130000000000002,"5min":1.4370000000000001,"15min":1.1220000000000001},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":24.102,"5min":24.102,"15min":24.102},"last":1.1000000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.016,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.4079999999999999,"5min":1.4810000000000001,"15min":2.4260000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.038,"15min":1.038},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.1240000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0489999999999999,"15min":1.0409999999999999},"min":{"1min":0.67800000000000005,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.133,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.22},{"interface":"front","average":{"1min":1.107,"5min":1.0449999999999999,"15min":1.069},"min":{"1min":0.78100000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3400000000000001,"5min":1.518,"15min":1.8320000000000001},"last":1.2410000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509651,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410668,"kb_used_data":90788,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961172,"statfs":{"total":96636764160,"available":96216240128,"internally_reserved":0,"allocated":92966912,"data_stored":92594645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.83999999999999997,"5min":0.998,"15min":1.1359999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.0189999999999999,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.28999999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.0620000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.75900000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.80800000000000005},"min":{"1min":0.38100000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.0289999999999999,"5min":2.8170000000000002,"15min":4.069},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":0.85499999999999998}]},{"osd":4,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.88700000000000001,"15min":0.86399999999999999},"min":{"1min":0.39800000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":5.8360000000000003,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.97799999999999998,"15min":0.97199999999999998},"min":{"1min":0.34799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.339,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":4.1200000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.008},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2130000000000001,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":0.88900000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.0700000000000001,"15min":1.0740000000000001},"min":{"1min":0.40600000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.29,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.095,"5min":0.98699999999999999,"15min":1.01},"min":{"1min":0.48699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.1740000000000004,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.1599999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:25:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1319999999999999,"15min":1.1279999999999999},"min":{"1min":0.56000000000000005,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.2370000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.034},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.0429999999999999,"15min":1.073},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":4.1509999999999998,"5min":4.1509999999999998,"15min":4.798},"last":1.0960000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542355,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319168,"kb_used_data":49336,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052672,"statfs":{"total":96636764160,"available":96309936128,"internally_reserved":0,"allocated":50520064,"data_stored":50148196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.26500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":0.77800000000000002,"15min":0.71299999999999997},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":11.132,"5min":11.132,"15min":11.132},"last":1.2010000000000001}]},{"osd":1,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.30199999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.421,"5min":1.857,"15min":3.3839999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69899999999999995,"15min":0.70199999999999996},"min":{"1min":0.35999999999999999,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.98799999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":0.86399999999999999,"15min":0.78200000000000003},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.331,"5min":0.93999999999999995,"15min":0.84299999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":12.657,"5min":12.657,"15min":12.657},"last":1.0209999999999999}]},{"osd":4,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.872,"15min":0.876},"min":{"1min":0.46600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.999,"5min":0.95999999999999996,"15min":0.94699999999999995},"min":{"1min":0.504,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.6879999999999999,"5min":2.609,"15min":2.609},"last":1.0569999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.92200000000000004,"15min":0.92700000000000005},"min":{"1min":0.53300000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.173},{"interface":"front","average":{"1min":0.995,"5min":1.032,"15min":1.008},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.587,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":0.83399999999999996}]},{"osd":6,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.6259999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.095,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.53500000000000003,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":1.095}]},{"osd":7,"last update":"Mon Mar 18 18:25:28 2024","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.157,"15min":1.0860000000000001},"min":{"1min":0.54600000000000004,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":13.02,"5min":13.02,"15min":13.02},"last":1.133},{"interface":"front","average":{"1min":1.077,"5min":1.0680000000000001,"15min":1.0740000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5600000000000001,"5min":1.893,"15min":1.9139999999999999},"last":0.76200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542354,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263664,"kb_used_data":34024,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108176,"statfs":{"total":96636764160,"available":96366772224,"internally_reserved":0,"allocated":34840576,"data_stored":34469140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.68000000000000005,"15min":0.621},"min":{"1min":0.20300000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":5.0229999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.37,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.0140000000000002,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.72399999999999998}]},{"osd":2,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":1.0649999999999999,"5min":2.048,"15min":2.048},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96599999999999997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.81599999999999995}]},{"osd":3,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.82199999999999995,"15min":0.77100000000000002},"min":{"1min":0.41199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.621},{"interface":"front","average":{"1min":1.226,"5min":0.93000000000000005,"15min":0.85599999999999998},"min":{"1min":0.48399999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.84999999999999998}]},{"osd":4,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.66000000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":1.143},{"interface":"front","average":{"1min":1.125,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.41199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.7169999999999996,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":1.167}]},{"osd":5,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0980000000000001,"15min":1.0169999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":5.0650000000000004,"5min":14.869,"15min":14.869},"last":1.353},{"interface":"front","average":{"1min":1.012,"5min":1.0880000000000001,"15min":1.022},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4870000000000001,"5min":14.804,"15min":14.804},"last":1.4199999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.157,"15min":1.0660000000000001},"min":{"1min":0.64300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":9.4049999999999994,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":1.446},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0189999999999999,"15min":1.016},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.4259999999999999,"5min":2.113,"15min":2.113},"last":1.2989999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.119,"15min":1.0720000000000001},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":11.455,"5min":11.455,"15min":11.455},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.294,"15min":1.167},"min":{"1min":0.77600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":11.430999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.2709999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106119168,"data_stored":106112848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80957440,"data_stored":80947606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":32851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":45093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":36924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:26:22.221 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.221 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.221 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.221 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.222 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.222 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.222 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.222 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.222 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.223 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.223 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.223 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.223 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.223 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.224 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.224 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.224 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T18:09:12.416688+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=9, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=18, tm_min=25, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T18:26:22.224 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T18:26:42.226 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T18:26:42.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f976316b700 1 Processor -- start 2024-03-18T18:26:42.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f976316b700 1 -- start start 2024-03-18T18:26:42.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f976316b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f975c148210 0x7f975c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f976316b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0b73e0 con 0x7f975c0b6230 2024-03-18T18:26:42.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f976316b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0b21e0 con 0x7f975c0b39b0 2024-03-18T18:26:42.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f976316b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c0b7070 con 0x7f975c148210 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f9760f07700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f975c0b6230 0x7f975c147b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42282/0 (socket says 172.21.15.94:42282) 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f9760f07700 1 -- 172.21.15.94:0/1614514589 learned_addr learned my addr 172.21.15.94:0/1614514589 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f975bfff700 1 --2- 172.21.15.94:0/1614514589 >> v2:172.21.15.94:3300/0 conn(0x7f975c148210 0x7f975c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f975b7fe700 1 -- 172.21.15.94:0/1614514589 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525952752 0 0) 0x7f975c0b73e0 con 0x7f975c0b6230 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f975b7fe700 1 -- 172.21.15.94:0/1614514589 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97440035d0 con 0x7f975c0b6230 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f975bfff700 1 -- 172.21.15.94:0/1614514589 >> v1:172.21.15.151:6789/0 conn(0x7f975c0b39b0 legacy=0x7f975c0b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f975bfff700 1 -- 172.21.15.94:0/1614514589 >> v1:172.21.15.94:6789/0 conn(0x7f975c0b6230 legacy=0x7f975c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.350+0000 7f975bfff700 1 -- 172.21.15.94:0/1614514589 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c072730 con 0x7f975c148210 2024-03-18T18:26:42.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f975bfff700 1 --2- 172.21.15.94:0/1614514589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c0b48e0 secure :-1 s=READY pgs=4533 cs=0 l=1 rev1=1 crypto rx=0x7f9750009850 tx=0x7f9750009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed12b50d9a1203b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f975b7fe700 1 -- 172.21.15.94:0/1614514589 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750011830 con 0x7f975c148210 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f975b7fe700 1 -- 172.21.15.94:0/1614514589 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750011990 con 0x7f975c148210 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f975b7fe700 1 -- 172.21.15.94:0/1614514589 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750011d40 con 0x7f975c148210 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 -- 172.21.15.94:0/1614514589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 msgr2=0x7f975c0b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 --2- 172.21.15.94:0/1614514589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c0b48e0 secure :-1 s=READY pgs=4533 cs=0 l=1 rev1=1 crypto rx=0x7f9750009850 tx=0x7f9750009b60 comp rx=0 tx=0).stop 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 -- 172.21.15.94:0/1614514589 shutdown_connections 2024-03-18T18:26:42.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 --2- 172.21.15.94:0/1614514589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c0b48e0 unknown :-1 s=CLOSED pgs=4533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 -- 172.21.15.94:0/1614514589 >> 172.21.15.94:0/1614514589 conn(0x7f975c06a570 msgr2=0x7f975c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:42.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 -- 172.21.15.94:0/1614514589 shutdown_connections 2024-03-18T18:26:42.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 -- 172.21.15.94:0/1614514589 wait complete. 2024-03-18T18:26:42.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.354+0000 7f976316b700 1 Processor -- start 2024-03-18T18:26:42.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 -- start start 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975c0b39b0 0x7f975c1d5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f975c0b6230 0x7f975c1dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c1dc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1441e0 con 0x7f975c148210 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1d5660 con 0x7f975c0b39b0 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c1d5920 con 0x7f975c0b6230 2024-03-18T18:26:42.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c1dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c1dc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54668/0 (socket says 172.21.15.94:54668) 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9760f07700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975c0b39b0 0x7f975c1d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 -- 172.21.15.94:0/3551666153 learned_addr learned my addr 172.21.15.94:0/3551666153 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f975bfff700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f975c0b6230 0x7f975c1dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 -- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f975c0b6230 msgr2=0x7f975c1dbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f975c0b6230 0x7f975c1dbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 -- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975c0b39b0 msgr2=0x7f975c1d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975c0b39b0 0x7f975c1d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 -- 172.21.15.94:0/3551666153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500094b0 con 0x7f975c148210 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f9761708700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c1dc030 secure :-1 s=READY pgs=4534 cs=0 l=1 rev1=1 crypto rx=0x7f975400cb40 tx=0x7f975400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754003c20 con 0x7f975c148210 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754003d80 con 0x7f975c148210 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c1db5f0 con 0x7f975c148210 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400aa20 con 0x7f975c148210 2024-03-18T18:26:42.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.358+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c1d5c00 con 0x7f975c148210 2024-03-18T18:26:42.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.362+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c06b370 con 0x7f975c148210 2024-03-18T18:26:42.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.362+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f975400ab80 con 0x7f975c148210 2024-03-18T18:26:42.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.362+0000 7f97597fa700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9748066730 0x7f9748068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.362+0000 7f9760f07700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9748066730 0x7f9748068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.362+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f97540840f0 con 0x7f975c148210 2024-03-18T18:26:42.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.362+0000 7f9760f07700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9748066730 0x7f9748068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f974c007fd0 tx=0x7f974c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:42.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.370+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f97540513c0 con 0x7f975c148210 2024-03-18T18:26:42.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.538+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 --> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f975c0b6610 con 0x7f9748066730 2024-03-18T18:26:42.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.554+0000 7f97597fa700 1 -- 172.21.15.94:0/3551666153 <== mgr.4101 v2:172.21.15.94:6832/25889 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293555 (secure 0 0 0) 0x7f974c006bf0 con 0x7f9748066730 2024-03-18T18:26:42.563 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9748066730 msgr2=0x7f9748068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9748066730 0x7f9748068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f974c007fd0 tx=0x7f974c007de0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 msgr2=0x7f975c1dc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c1dc030 secure :-1 s=READY pgs=4534 cs=0 l=1 rev1=1 crypto rx=0x7f975400cb40 tx=0x7f975400ce50 comp rx=0 tx=0).stop 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 shutdown_connections 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9748066730 0x7f9748068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f975c148210 0x7f975c1dc030 unknown :-1 s=CLOSED pgs=4534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f975c0b6230 0x7f975c1dbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 --2- 172.21.15.94:0/3551666153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975c0b39b0 0x7f975c1d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 >> 172.21.15.94:0/3551666153 conn(0x7f975c06a570 msgr2=0x7f975c0b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:42.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 shutdown_connections 2024-03-18T18:26:42.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.558+0000 7f976316b700 1 -- 172.21.15.94:0/3551666153 wait complete. 2024-03-18T18:26:42.567 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-03-18T18:26:42.577 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":580,"stamp":"2024-03-18T18:26:40.938195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265707618,"num_objects":228,"num_object_clones":28,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":15,"num_read":1722,"num_read_kb":4075,"num_write":163797,"num_write_kb":738450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35843,"num_omap_keys":70,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327366,"ondisk_log_size":327366,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2946784,"kb_used_data":524128,"kb_used_omap":12,"kb_used_meta":2422579,"kb_avail":752027936,"statfs":{"total":773094113280,"available":770076606464,"internally_reserved":0,"allocated":536707072,"data_stored":533742460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12740,"internal_metadata":2480721468},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004311"},"pg_stats":[{"pgid":"3.3f","version":"56'3535","reported_seq":2958,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:37.385611+0000","last_change":"2024-03-18T18:26:37.385763+0000","last_active":"2024-03-18T18:26:37.385611+0000","last_peered":"2024-03-18T18:26:37.385611+0000","last_clean":"2024-03-18T18:26:37.385611+0000","last_became_active":"2024-03-18T18:09:12.849968+0000","last_became_peered":"2024-03-18T18:09:12.849968+0000","last_unstale":"2024-03-18T18:26:37.385611+0000","last_undegraded":"2024-03-18T18:26:37.385611+0000","last_fullsized":"2024-03-18T18:26:37.385611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3535","last_scrub_stamp":"2024-03-18T18:26:37.385591+0000","last_deep_scrub":"56'3535","last_deep_scrub_stamp":"2024-03-18T18:26:37.385591+0000","last_clean_scrub_stamp":"2024-03-18T18:26:37.385591+0000","objects_scrubbed":3,"log_size":3535,"log_dups_size":0,"ondisk_log_size":3535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:13:21.568017+0000","scrub_duration":0.033070294,"objects_trimmed":0,"snaptrim_duration":0.0085279770000000008,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"54'3322","reported_seq":2762,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:15.166796+0000","last_change":"2024-03-18T18:26:15.167274+0000","last_active":"2024-03-18T18:26:15.166796+0000","last_peered":"2024-03-18T18:26:15.166796+0000","last_clean":"2024-03-18T18:26:15.166796+0000","last_became_active":"2024-03-18T18:09:12.829083+0000","last_became_peered":"2024-03-18T18:09:12.829083+0000","last_unstale":"2024-03-18T18:26:15.166796+0000","last_undegraded":"2024-03-18T18:26:15.166796+0000","last_fullsized":"2024-03-18T18:26:15.166796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3322","last_scrub_stamp":"2024-03-18T18:26:15.166730+0000","last_deep_scrub":"54'3322","last_deep_scrub_stamp":"2024-03-18T18:26:15.166730+0000","last_clean_scrub_stamp":"2024-03-18T18:26:15.166730+0000","objects_scrubbed":0,"log_size":3322,"log_dups_size":0,"ondisk_log_size":3322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:15:08.335174+0000","scrub_duration":0.026966192999999999,"objects_trimmed":0,"snaptrim_duration":0.047073203000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"56'3571","reported_seq":2994,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:58.807809+0000","last_change":"2024-03-18T18:25:58.807942+0000","last_active":"2024-03-18T18:25:58.807809+0000","last_peered":"2024-03-18T18:25:58.807809+0000","last_clean":"2024-03-18T18:25:58.807809+0000","last_became_active":"2024-03-18T18:09:12.831212+0000","last_became_peered":"2024-03-18T18:09:12.831212+0000","last_unstale":"2024-03-18T18:25:58.807809+0000","last_undegraded":"2024-03-18T18:25:58.807809+0000","last_fullsized":"2024-03-18T18:25:58.807809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3571","last_scrub_stamp":"2024-03-18T18:25:58.807786+0000","last_deep_scrub":"56'3571","last_deep_scrub_stamp":"2024-03-18T18:25:58.807786+0000","last_clean_scrub_stamp":"2024-03-18T18:25:58.807786+0000","objects_scrubbed":1,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:27.440135+0000","scrub_duration":0.034988533000000002,"objects_trimmed":0,"snaptrim_duration":0.045526931999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1128,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"56'3830","reported_seq":3153,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:23.571629+0000","last_change":"2024-03-18T18:26:23.571947+0000","last_active":"2024-03-18T18:26:23.571629+0000","last_peered":"2024-03-18T18:26:23.571629+0000","last_clean":"2024-03-18T18:26:23.571629+0000","last_became_active":"2024-03-18T18:09:12.843882+0000","last_became_peered":"2024-03-18T18:09:12.843882+0000","last_unstale":"2024-03-18T18:26:23.571629+0000","last_undegraded":"2024-03-18T18:26:23.571629+0000","last_fullsized":"2024-03-18T18:26:23.571629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3830","last_scrub_stamp":"2024-03-18T18:26:23.571553+0000","last_deep_scrub":"56'3830","last_deep_scrub_stamp":"2024-03-18T18:26:23.571553+0000","last_clean_scrub_stamp":"2024-03-18T18:26:23.571553+0000","objects_scrubbed":1,"log_size":3830,"log_dups_size":0,"ondisk_log_size":3830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:15:16.739997+0000","scrub_duration":0.048577276000000003,"objects_trimmed":0,"snaptrim_duration":0.026494391999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1261,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"54'3564","reported_seq":2942,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:23.306662+0000","last_change":"2024-03-18T18:26:23.307061+0000","last_active":"2024-03-18T18:26:23.306662+0000","last_peered":"2024-03-18T18:26:23.306662+0000","last_clean":"2024-03-18T18:26:23.306662+0000","last_became_active":"2024-03-18T18:09:12.832197+0000","last_became_peered":"2024-03-18T18:09:12.832197+0000","last_unstale":"2024-03-18T18:26:23.306662+0000","last_undegraded":"2024-03-18T18:26:23.306662+0000","last_fullsized":"2024-03-18T18:26:23.306662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3564","last_scrub_stamp":"2024-03-18T18:26:23.306592+0000","last_deep_scrub":"54'3564","last_deep_scrub_stamp":"2024-03-18T18:26:23.306592+0000","last_clean_scrub_stamp":"2024-03-18T18:26:23.306592+0000","objects_scrubbed":0,"log_size":3564,"log_dups_size":0,"ondisk_log_size":3564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:42:41.302592+0000","scrub_duration":0.035865282999999998,"objects_trimmed":0,"snaptrim_duration":0.0087081929999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"56'3683","reported_seq":3025,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:14.003967+0000","last_change":"2024-03-18T18:26:14.004088+0000","last_active":"2024-03-18T18:26:14.003967+0000","last_peered":"2024-03-18T18:26:14.003967+0000","last_clean":"2024-03-18T18:26:14.003967+0000","last_became_active":"2024-03-18T18:09:54.941887+0000","last_became_peered":"2024-03-18T18:09:54.941887+0000","last_unstale":"2024-03-18T18:26:14.003967+0000","last_undegraded":"2024-03-18T18:26:14.003967+0000","last_fullsized":"2024-03-18T18:26:14.003967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3683","last_scrub_stamp":"2024-03-18T18:26:14.003947+0000","last_deep_scrub":"56'3683","last_deep_scrub_stamp":"2024-03-18T18:26:14.003947+0000","last_clean_scrub_stamp":"2024-03-18T18:26:14.003947+0000","objects_scrubbed":2,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:51:24.504478+0000","scrub_duration":0.036112544000000003,"objects_trimmed":0,"snaptrim_duration":0.021742939999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"56'3921","reported_seq":3258,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:31.348038+0000","last_change":"2024-03-18T18:26:31.348165+0000","last_active":"2024-03-18T18:26:31.348038+0000","last_peered":"2024-03-18T18:26:31.348038+0000","last_clean":"2024-03-18T18:26:31.348038+0000","last_became_active":"2024-03-18T18:09:12.830542+0000","last_became_peered":"2024-03-18T18:09:12.830542+0000","last_unstale":"2024-03-18T18:26:31.348038+0000","last_undegraded":"2024-03-18T18:26:31.348038+0000","last_fullsized":"2024-03-18T18:26:31.348038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3921","last_scrub_stamp":"2024-03-18T18:26:31.348015+0000","last_deep_scrub":"56'3921","last_deep_scrub_stamp":"2024-03-18T18:26:31.348015+0000","last_clean_scrub_stamp":"2024-03-18T18:26:31.348015+0000","objects_scrubbed":2,"log_size":3921,"log_dups_size":0,"ondisk_log_size":3921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:26.875440+0000","scrub_duration":0.043720890999999998,"objects_trimmed":0,"snaptrim_duration":0.0061713599999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"56'3532","reported_seq":2956,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:02.052898+0000","last_change":"2024-03-18T18:26:02.053047+0000","last_active":"2024-03-18T18:26:02.052898+0000","last_peered":"2024-03-18T18:26:02.052898+0000","last_clean":"2024-03-18T18:26:02.052898+0000","last_became_active":"2024-03-18T18:09:54.809525+0000","last_became_peered":"2024-03-18T18:09:54.809525+0000","last_unstale":"2024-03-18T18:26:02.052898+0000","last_undegraded":"2024-03-18T18:26:02.052898+0000","last_fullsized":"2024-03-18T18:26:02.052898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3532","last_scrub_stamp":"2024-03-18T18:26:02.052878+0000","last_deep_scrub":"56'3532","last_deep_scrub_stamp":"2024-03-18T18:26:02.052878+0000","last_clean_scrub_stamp":"2024-03-18T18:26:02.052878+0000","objects_scrubbed":4,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:25:01.236731+0000","scrub_duration":0.051984388999999999,"objects_trimmed":0,"snaptrim_duration":0.019135930999999998,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"56'3893","reported_seq":3266,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:32.348254+0000","last_change":"2024-03-18T18:26:32.348389+0000","last_active":"2024-03-18T18:26:32.348254+0000","last_peered":"2024-03-18T18:26:32.348254+0000","last_clean":"2024-03-18T18:26:32.348254+0000","last_became_active":"2024-03-18T18:09:12.850938+0000","last_became_peered":"2024-03-18T18:09:12.850938+0000","last_unstale":"2024-03-18T18:26:32.348254+0000","last_undegraded":"2024-03-18T18:26:32.348254+0000","last_fullsized":"2024-03-18T18:26:32.348254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3893","last_scrub_stamp":"2024-03-18T18:26:32.348231+0000","last_deep_scrub":"56'3893","last_deep_scrub_stamp":"2024-03-18T18:26:32.348231+0000","last_clean_scrub_stamp":"2024-03-18T18:26:32.348231+0000","objects_scrubbed":5,"log_size":3893,"log_dups_size":0,"ondisk_log_size":3893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:50:22.765131+0000","scrub_duration":0.061293279999999999,"objects_trimmed":0,"snaptrim_duration":0.0076803130000000002,"stat_sum":{"num_bytes":4107,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"56'3832","reported_seq":3263,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:22.019334+0000","last_change":"2024-03-18T18:26:22.019568+0000","last_active":"2024-03-18T18:26:22.019334+0000","last_peered":"2024-03-18T18:26:22.019334+0000","last_clean":"2024-03-18T18:26:22.019334+0000","last_became_active":"2024-03-18T18:09:12.843409+0000","last_became_peered":"2024-03-18T18:09:12.843409+0000","last_unstale":"2024-03-18T18:26:22.019334+0000","last_undegraded":"2024-03-18T18:26:22.019334+0000","last_fullsized":"2024-03-18T18:26:22.019334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3832","last_scrub_stamp":"2024-03-18T18:26:22.019292+0000","last_deep_scrub":"56'3832","last_deep_scrub_stamp":"2024-03-18T18:26:22.019292+0000","last_clean_scrub_stamp":"2024-03-18T18:26:22.019292+0000","objects_scrubbed":4,"log_size":3832,"log_dups_size":0,"ondisk_log_size":3832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:58:00.780284+0000","scrub_duration":0.045536215999999997,"objects_trimmed":0,"snaptrim_duration":0.021733178999999998,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1107,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"56'3543","reported_seq":2982,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.070491+0000","last_change":"2024-03-18T18:26:11.070597+0000","last_active":"2024-03-18T18:26:11.070491+0000","last_peered":"2024-03-18T18:26:11.070491+0000","last_clean":"2024-03-18T18:26:11.070491+0000","last_became_active":"2024-03-18T18:09:12.849616+0000","last_became_peered":"2024-03-18T18:09:12.849616+0000","last_unstale":"2024-03-18T18:26:11.070491+0000","last_undegraded":"2024-03-18T18:26:11.070491+0000","last_fullsized":"2024-03-18T18:26:11.070491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3543","last_scrub_stamp":"2024-03-18T18:26:11.070467+0000","last_deep_scrub":"56'3543","last_deep_scrub_stamp":"2024-03-18T18:26:11.070467+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.070467+0000","objects_scrubbed":1,"log_size":3543,"log_dups_size":0,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:51:21.570999+0000","scrub_duration":0.030295255,"objects_trimmed":0,"snaptrim_duration":0.017212847,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"54'4127","reported_seq":3435,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:55.455436+0000","last_change":"2024-03-18T18:25:55.455436+0000","last_active":"2024-03-18T18:25:55.455436+0000","last_peered":"2024-03-18T18:25:55.455436+0000","last_clean":"2024-03-18T18:25:55.455436+0000","last_became_active":"2024-03-18T18:09:12.848922+0000","last_became_peered":"2024-03-18T18:09:12.848922+0000","last_unstale":"2024-03-18T18:25:55.455436+0000","last_undegraded":"2024-03-18T18:25:55.455436+0000","last_fullsized":"2024-03-18T18:25:55.455436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4127","last_scrub_stamp":"2024-03-18T18:25:55.455217+0000","last_deep_scrub":"54'4127","last_deep_scrub_stamp":"2024-03-18T18:25:55.455217+0000","last_clean_scrub_stamp":"2024-03-18T18:25:55.455217+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:39:08.916529+0000","scrub_duration":0.047245723000000003,"objects_trimmed":0,"snaptrim_duration":0.005688551,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"56'3612","reported_seq":3033,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:26.120670+0000","last_change":"2024-03-18T18:26:26.120830+0000","last_active":"2024-03-18T18:26:26.120670+0000","last_peered":"2024-03-18T18:26:26.120670+0000","last_clean":"2024-03-18T18:26:26.120670+0000","last_became_active":"2024-03-18T18:09:12.848678+0000","last_became_peered":"2024-03-18T18:09:12.848678+0000","last_unstale":"2024-03-18T18:26:26.120670+0000","last_undegraded":"2024-03-18T18:26:26.120670+0000","last_fullsized":"2024-03-18T18:26:26.120670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3612","last_scrub_stamp":"2024-03-18T18:26:26.120644+0000","last_deep_scrub":"56'3612","last_deep_scrub_stamp":"2024-03-18T18:26:26.120644+0000","last_clean_scrub_stamp":"2024-03-18T18:26:26.120644+0000","objects_scrubbed":4,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:34:08.313162+0000","scrub_duration":0.034681047,"objects_trimmed":0,"snaptrim_duration":0.012411574,"stat_sum":{"num_bytes":8192,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"56'3872","reported_seq":3185,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:57.777261+0000","last_change":"2024-03-18T18:25:57.777426+0000","last_active":"2024-03-18T18:25:57.777261+0000","last_peered":"2024-03-18T18:25:57.777261+0000","last_clean":"2024-03-18T18:25:57.777261+0000","last_became_active":"2024-03-18T18:09:12.834170+0000","last_became_peered":"2024-03-18T18:09:12.834170+0000","last_unstale":"2024-03-18T18:25:57.777261+0000","last_undegraded":"2024-03-18T18:25:57.777261+0000","last_fullsized":"2024-03-18T18:25:57.777261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3872","last_scrub_stamp":"2024-03-18T18:25:57.777233+0000","last_deep_scrub":"56'3872","last_deep_scrub_stamp":"2024-03-18T18:25:57.777233+0000","last_clean_scrub_stamp":"2024-03-18T18:25:57.777233+0000","objects_scrubbed":1,"log_size":3872,"log_dups_size":0,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:16:52.332974+0000","scrub_duration":0.035250040000000003,"objects_trimmed":0,"snaptrim_duration":0.041577736999999997,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"56'3833","reported_seq":3170,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:10.199717+0000","last_change":"2024-03-18T18:26:10.199906+0000","last_active":"2024-03-18T18:26:10.199717+0000","last_peered":"2024-03-18T18:26:10.199717+0000","last_clean":"2024-03-18T18:26:10.199717+0000","last_became_active":"2024-03-18T18:09:12.825602+0000","last_became_peered":"2024-03-18T18:09:12.825602+0000","last_unstale":"2024-03-18T18:26:10.199717+0000","last_undegraded":"2024-03-18T18:26:10.199717+0000","last_fullsized":"2024-03-18T18:26:10.199717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3833","last_scrub_stamp":"2024-03-18T18:26:10.199681+0000","last_deep_scrub":"56'3833","last_deep_scrub_stamp":"2024-03-18T18:26:10.199681+0000","last_clean_scrub_stamp":"2024-03-18T18:26:10.199681+0000","objects_scrubbed":4,"log_size":3833,"log_dups_size":0,"ondisk_log_size":3833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:53:19.324884+0000","scrub_duration":0.054462076999999998,"objects_trimmed":0,"snaptrim_duration":0.029828624000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1208,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"56'4023","reported_seq":3346,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:29.637937+0000","last_change":"2024-03-18T18:26:29.638056+0000","last_active":"2024-03-18T18:26:29.637937+0000","last_peered":"2024-03-18T18:26:29.637937+0000","last_clean":"2024-03-18T18:26:29.637937+0000","last_became_active":"2024-03-18T18:09:12.846472+0000","last_became_peered":"2024-03-18T18:09:12.846472+0000","last_unstale":"2024-03-18T18:26:29.637937+0000","last_undegraded":"2024-03-18T18:26:29.637937+0000","last_fullsized":"2024-03-18T18:26:29.637937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4023","last_scrub_stamp":"2024-03-18T18:26:29.637916+0000","last_deep_scrub":"56'4023","last_deep_scrub_stamp":"2024-03-18T18:26:29.637916+0000","last_clean_scrub_stamp":"2024-03-18T18:26:29.637916+0000","objects_scrubbed":1,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:42:47.633916+0000","scrub_duration":0.043807382999999998,"objects_trimmed":0,"snaptrim_duration":0.024131980000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"54'3796","reported_seq":3116,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:07.466110+0000","last_change":"2024-03-18T18:26:07.466237+0000","last_active":"2024-03-18T18:26:07.466110+0000","last_peered":"2024-03-18T18:26:07.466110+0000","last_clean":"2024-03-18T18:26:07.466110+0000","last_became_active":"2024-03-18T18:09:12.842738+0000","last_became_peered":"2024-03-18T18:09:12.842738+0000","last_unstale":"2024-03-18T18:26:07.466110+0000","last_undegraded":"2024-03-18T18:26:07.466110+0000","last_fullsized":"2024-03-18T18:26:07.466110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3796","last_scrub_stamp":"2024-03-18T18:26:07.466087+0000","last_deep_scrub":"54'3796","last_deep_scrub_stamp":"2024-03-18T18:26:07.466087+0000","last_clean_scrub_stamp":"2024-03-18T18:26:07.466087+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:14:10.043992+0000","scrub_duration":0.031304364000000001,"objects_trimmed":0,"snaptrim_duration":0.027115495999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"56'3742","reported_seq":3157,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.967487+0000","last_change":"2024-03-18T18:25:46.967699+0000","last_active":"2024-03-18T18:25:46.967487+0000","last_peered":"2024-03-18T18:25:46.967487+0000","last_clean":"2024-03-18T18:25:46.967487+0000","last_became_active":"2024-03-18T18:09:12.849025+0000","last_became_peered":"2024-03-18T18:09:12.849025+0000","last_unstale":"2024-03-18T18:25:46.967487+0000","last_undegraded":"2024-03-18T18:25:46.967487+0000","last_fullsized":"2024-03-18T18:25:46.967487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3742","last_scrub_stamp":"2024-03-18T18:25:46.967421+0000","last_deep_scrub":"56'3742","last_deep_scrub_stamp":"2024-03-18T18:25:46.967421+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.967421+0000","objects_scrubbed":4,"log_size":3742,"log_dups_size":0,"ondisk_log_size":3742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:39:00.428733+0000","scrub_duration":0.041615524000000001,"objects_trimmed":0,"snaptrim_duration":0.016442126000000001,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"56'3975","reported_seq":3290,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:24.325782+0000","last_change":"2024-03-18T18:26:24.325915+0000","last_active":"2024-03-18T18:26:24.325782+0000","last_peered":"2024-03-18T18:26:24.325782+0000","last_clean":"2024-03-18T18:26:24.325782+0000","last_became_active":"2024-03-18T18:09:12.831714+0000","last_became_peered":"2024-03-18T18:09:12.831714+0000","last_unstale":"2024-03-18T18:26:24.325782+0000","last_undegraded":"2024-03-18T18:26:24.325782+0000","last_fullsized":"2024-03-18T18:26:24.325782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3975","last_scrub_stamp":"2024-03-18T18:26:24.325754+0000","last_deep_scrub":"56'3975","last_deep_scrub_stamp":"2024-03-18T18:26:24.325754+0000","last_clean_scrub_stamp":"2024-03-18T18:26:24.325754+0000","objects_scrubbed":3,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:44.305775+0000","scrub_duration":0.048662270000000001,"objects_trimmed":0,"snaptrim_duration":0.007953636,"stat_sum":{"num_bytes":9,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"56'3759","reported_seq":3132,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:16.023642+0000","last_change":"2024-03-18T18:26:16.023774+0000","last_active":"2024-03-18T18:26:16.023642+0000","last_peered":"2024-03-18T18:26:16.023642+0000","last_clean":"2024-03-18T18:26:16.023642+0000","last_became_active":"2024-03-18T18:09:12.843207+0000","last_became_peered":"2024-03-18T18:09:12.843207+0000","last_unstale":"2024-03-18T18:26:16.023642+0000","last_undegraded":"2024-03-18T18:26:16.023642+0000","last_fullsized":"2024-03-18T18:26:16.023642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3759","last_scrub_stamp":"2024-03-18T18:26:16.023618+0000","last_deep_scrub":"56'3759","last_deep_scrub_stamp":"2024-03-18T18:26:16.023618+0000","last_clean_scrub_stamp":"2024-03-18T18:26:16.023618+0000","objects_scrubbed":4,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:18.007659+0000","scrub_duration":0.058141316999999998,"objects_trimmed":0,"snaptrim_duration":0.018517942999999999,"stat_sum":{"num_bytes":4110,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"56'3499","reported_seq":2932,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:08.839985+0000","last_change":"2024-03-18T18:26:08.840282+0000","last_active":"2024-03-18T18:26:08.839985+0000","last_peered":"2024-03-18T18:26:08.839985+0000","last_clean":"2024-03-18T18:26:08.839985+0000","last_became_active":"2024-03-18T18:09:12.834818+0000","last_became_peered":"2024-03-18T18:09:12.834818+0000","last_unstale":"2024-03-18T18:26:08.839985+0000","last_undegraded":"2024-03-18T18:26:08.839985+0000","last_fullsized":"2024-03-18T18:26:08.839985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3499","last_scrub_stamp":"2024-03-18T18:26:08.839925+0000","last_deep_scrub":"56'3499","last_deep_scrub_stamp":"2024-03-18T18:26:08.839925+0000","last_clean_scrub_stamp":"2024-03-18T18:26:08.839925+0000","objects_scrubbed":4,"log_size":3499,"log_dups_size":0,"ondisk_log_size":3499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:12:07.915856+0000","scrub_duration":0.052096138,"objects_trimmed":0,"snaptrim_duration":0.052784690000000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"56'4358","reported_seq":3589,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:30.640007+0000","last_change":"2024-03-18T18:26:30.640345+0000","last_active":"2024-03-18T18:26:30.640007+0000","last_peered":"2024-03-18T18:26:30.640007+0000","last_clean":"2024-03-18T18:26:30.640007+0000","last_became_active":"2024-03-18T18:09:12.847025+0000","last_became_peered":"2024-03-18T18:09:12.847025+0000","last_unstale":"2024-03-18T18:26:30.640007+0000","last_undegraded":"2024-03-18T18:26:30.640007+0000","last_fullsized":"2024-03-18T18:26:30.640007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4358","last_scrub_stamp":"2024-03-18T18:26:30.639941+0000","last_deep_scrub":"56'4358","last_deep_scrub_stamp":"2024-03-18T18:26:30.639941+0000","last_clean_scrub_stamp":"2024-03-18T18:26:30.639941+0000","objects_scrubbed":2,"log_size":4358,"log_dups_size":0,"ondisk_log_size":4358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:50.619962+0000","scrub_duration":0.042900262000000002,"objects_trimmed":0,"snaptrim_duration":0.031359316999999998,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"54'3901","reported_seq":3246,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:01.029665+0000","last_change":"2024-03-18T18:26:01.029944+0000","last_active":"2024-03-18T18:26:01.029665+0000","last_peered":"2024-03-18T18:26:01.029665+0000","last_clean":"2024-03-18T18:26:01.029665+0000","last_became_active":"2024-03-18T18:09:12.827203+0000","last_became_peered":"2024-03-18T18:09:12.827203+0000","last_unstale":"2024-03-18T18:26:01.029665+0000","last_undegraded":"2024-03-18T18:26:01.029665+0000","last_fullsized":"2024-03-18T18:26:01.029665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3901","last_scrub_stamp":"2024-03-18T18:26:01.029608+0000","last_deep_scrub":"54'3901","last_deep_scrub_stamp":"2024-03-18T18:26:01.029608+0000","last_clean_scrub_stamp":"2024-03-18T18:26:01.029608+0000","objects_scrubbed":0,"log_size":3901,"log_dups_size":0,"ondisk_log_size":3901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:16:55.585349+0000","scrub_duration":0.047324324000000001,"objects_trimmed":0,"snaptrim_duration":0.012305192,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1122,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"54'4190","reported_seq":3423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:24.522516+0000","last_change":"2024-03-18T18:26:24.522516+0000","last_active":"2024-03-18T18:26:24.522516+0000","last_peered":"2024-03-18T18:26:24.522516+0000","last_clean":"2024-03-18T18:26:24.522516+0000","last_became_active":"2024-03-18T18:09:12.834081+0000","last_became_peered":"2024-03-18T18:09:12.834081+0000","last_unstale":"2024-03-18T18:26:24.522516+0000","last_undegraded":"2024-03-18T18:26:24.522516+0000","last_fullsized":"2024-03-18T18:26:24.522516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4190","last_scrub_stamp":"2024-03-18T18:26:24.522263+0000","last_deep_scrub":"54'4190","last_deep_scrub_stamp":"2024-03-18T18:26:24.522263+0000","last_clean_scrub_stamp":"2024-03-18T18:26:24.522263+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:58.058018+0000","scrub_duration":0.038047093999999997,"objects_trimmed":0,"snaptrim_duration":0.025173923000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"54'3282","reported_seq":2738,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:23.134478+0000","last_change":"2024-03-18T18:26:23.134478+0000","last_active":"2024-03-18T18:26:23.134478+0000","last_peered":"2024-03-18T18:26:23.134478+0000","last_clean":"2024-03-18T18:26:23.134478+0000","last_became_active":"2024-03-18T18:09:12.827386+0000","last_became_peered":"2024-03-18T18:09:12.827386+0000","last_unstale":"2024-03-18T18:26:23.134478+0000","last_undegraded":"2024-03-18T18:26:23.134478+0000","last_fullsized":"2024-03-18T18:26:23.134478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3282","last_scrub_stamp":"2024-03-18T18:26:23.134333+0000","last_deep_scrub":"54'3282","last_deep_scrub_stamp":"2024-03-18T18:26:23.134333+0000","last_clean_scrub_stamp":"2024-03-18T18:26:23.134333+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:35:02.676191+0000","scrub_duration":0.029690794999999999,"objects_trimmed":0,"snaptrim_duration":0.012191212999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1092,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"56'3789","reported_seq":3164,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:17.998899+0000","last_change":"2024-03-18T18:26:17.998899+0000","last_active":"2024-03-18T18:26:17.998899+0000","last_peered":"2024-03-18T18:26:17.998899+0000","last_clean":"2024-03-18T18:26:17.998899+0000","last_became_active":"2024-03-18T18:09:12.847655+0000","last_became_peered":"2024-03-18T18:09:12.847655+0000","last_unstale":"2024-03-18T18:26:17.998899+0000","last_undegraded":"2024-03-18T18:26:17.998899+0000","last_fullsized":"2024-03-18T18:26:17.998899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3789","last_scrub_stamp":"2024-03-18T18:26:17.998677+0000","last_deep_scrub":"56'3789","last_deep_scrub_stamp":"2024-03-18T18:26:17.998677+0000","last_clean_scrub_stamp":"2024-03-18T18:26:17.998677+0000","objects_scrubbed":4,"log_size":3789,"log_dups_size":0,"ondisk_log_size":3789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:19:47.884453+0000","scrub_duration":0.048054445000000001,"objects_trimmed":0,"snaptrim_duration":0.020801094999999999,"stat_sum":{"num_bytes":4105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"56'3858","reported_seq":3189,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:19.183573+0000","last_change":"2024-03-18T18:26:19.183573+0000","last_active":"2024-03-18T18:26:19.183573+0000","last_peered":"2024-03-18T18:26:19.183573+0000","last_clean":"2024-03-18T18:26:19.183573+0000","last_became_active":"2024-03-18T18:09:12.824911+0000","last_became_peered":"2024-03-18T18:09:12.824911+0000","last_unstale":"2024-03-18T18:26:19.183573+0000","last_undegraded":"2024-03-18T18:26:19.183573+0000","last_fullsized":"2024-03-18T18:26:19.183573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3858","last_scrub_stamp":"2024-03-18T18:26:19.183428+0000","last_deep_scrub":"56'3858","last_deep_scrub_stamp":"2024-03-18T18:26:19.183428+0000","last_clean_scrub_stamp":"2024-03-18T18:26:19.183428+0000","objects_scrubbed":1,"log_size":3858,"log_dups_size":0,"ondisk_log_size":3858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:15:23.915649+0000","scrub_duration":0.036337407000000002,"objects_trimmed":0,"snaptrim_duration":0.048165568999999998,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"54'3360","reported_seq":2817,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:02.004463+0000","last_change":"2024-03-18T18:26:02.004463+0000","last_active":"2024-03-18T18:26:02.004463+0000","last_peered":"2024-03-18T18:26:02.004463+0000","last_clean":"2024-03-18T18:26:02.004463+0000","last_became_active":"2024-03-18T18:09:12.826758+0000","last_became_peered":"2024-03-18T18:09:12.826758+0000","last_unstale":"2024-03-18T18:26:02.004463+0000","last_undegraded":"2024-03-18T18:26:02.004463+0000","last_fullsized":"2024-03-18T18:26:02.004463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3360","last_scrub_stamp":"2024-03-18T18:26:02.004337+0000","last_deep_scrub":"54'3360","last_deep_scrub_stamp":"2024-03-18T18:26:02.004337+0000","last_clean_scrub_stamp":"2024-03-18T18:26:02.004337+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:30.636687+0000","scrub_duration":0.037008526,"objects_trimmed":0,"snaptrim_duration":0.012428754,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1082,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"56'3865","reported_seq":3218,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:07.818562+0000","last_change":"2024-03-18T18:26:07.818741+0000","last_active":"2024-03-18T18:26:07.818562+0000","last_peered":"2024-03-18T18:26:07.818562+0000","last_clean":"2024-03-18T18:26:07.818562+0000","last_became_active":"2024-03-18T18:09:12.834264+0000","last_became_peered":"2024-03-18T18:09:12.834264+0000","last_unstale":"2024-03-18T18:26:07.818562+0000","last_undegraded":"2024-03-18T18:26:07.818562+0000","last_fullsized":"2024-03-18T18:26:07.818562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3865","last_scrub_stamp":"2024-03-18T18:26:07.818529+0000","last_deep_scrub":"56'3865","last_deep_scrub_stamp":"2024-03-18T18:26:07.818529+0000","last_clean_scrub_stamp":"2024-03-18T18:26:07.818529+0000","objects_scrubbed":3,"log_size":3865,"log_dups_size":0,"ondisk_log_size":3865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:08:09.756202+0000","scrub_duration":0.033042113999999997,"objects_trimmed":0,"snaptrim_duration":0.051819236999999997,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"56'3279","reported_seq":2742,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:27.568021+0000","last_change":"2024-03-18T18:26:27.568169+0000","last_active":"2024-03-18T18:26:27.568021+0000","last_peered":"2024-03-18T18:26:27.568021+0000","last_clean":"2024-03-18T18:26:27.568021+0000","last_became_active":"2024-03-18T18:09:12.847313+0000","last_became_peered":"2024-03-18T18:09:12.847313+0000","last_unstale":"2024-03-18T18:26:27.568021+0000","last_undegraded":"2024-03-18T18:26:27.568021+0000","last_fullsized":"2024-03-18T18:26:27.568021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3279","last_scrub_stamp":"2024-03-18T18:26:27.567993+0000","last_deep_scrub":"56'3279","last_deep_scrub_stamp":"2024-03-18T18:26:27.567993+0000","last_clean_scrub_stamp":"2024-03-18T18:26:27.567993+0000","objects_scrubbed":4,"log_size":3279,"log_dups_size":0,"ondisk_log_size":3279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:15:32.300215+0000","scrub_duration":0.045201142999999999,"objects_trimmed":0,"snaptrim_duration":0.033663928000000003,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1081,"num_write_kb":585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"56'4262","reported_seq":3518,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.968689+0000","last_change":"2024-03-18T18:25:47.968689+0000","last_active":"2024-03-18T18:25:47.968689+0000","last_peered":"2024-03-18T18:25:47.968689+0000","last_clean":"2024-03-18T18:25:47.968689+0000","last_became_active":"2024-03-18T18:09:12.843587+0000","last_became_peered":"2024-03-18T18:09:12.843587+0000","last_unstale":"2024-03-18T18:25:47.968689+0000","last_undegraded":"2024-03-18T18:25:47.968689+0000","last_fullsized":"2024-03-18T18:25:47.968689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4262","last_scrub_stamp":"2024-03-18T18:25:47.968474+0000","last_deep_scrub":"56'4262","last_deep_scrub_stamp":"2024-03-18T18:25:47.968474+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.968474+0000","objects_scrubbed":2,"log_size":4262,"log_dups_size":0,"ondisk_log_size":4262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:48.817587+0000","scrub_duration":0.043698319999999999,"objects_trimmed":0,"snaptrim_duration":0.025269438000000002,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"56'3988","reported_seq":3291,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:17.008031+0000","last_change":"2024-03-18T18:26:17.008207+0000","last_active":"2024-03-18T18:26:17.008031+0000","last_peered":"2024-03-18T18:26:17.008031+0000","last_clean":"2024-03-18T18:26:17.008031+0000","last_became_active":"2024-03-18T18:09:12.847070+0000","last_became_peered":"2024-03-18T18:09:12.847070+0000","last_unstale":"2024-03-18T18:26:17.008031+0000","last_undegraded":"2024-03-18T18:26:17.008031+0000","last_fullsized":"2024-03-18T18:26:17.008031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3988","last_scrub_stamp":"2024-03-18T18:26:17.008005+0000","last_deep_scrub":"56'3988","last_deep_scrub_stamp":"2024-03-18T18:26:17.008005+0000","last_clean_scrub_stamp":"2024-03-18T18:26:17.008005+0000","objects_scrubbed":3,"log_size":3988,"log_dups_size":0,"ondisk_log_size":3988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:53:26.133208+0000","scrub_duration":0.044919591000000002,"objects_trimmed":0,"snaptrim_duration":0.021027502,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"56'4044","reported_seq":3329,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:52.496669+0000","last_change":"2024-03-18T18:25:52.496847+0000","last_active":"2024-03-18T18:25:52.496669+0000","last_peered":"2024-03-18T18:25:52.496669+0000","last_clean":"2024-03-18T18:25:52.496669+0000","last_became_active":"2024-03-18T18:09:12.827387+0000","last_became_peered":"2024-03-18T18:09:12.827387+0000","last_unstale":"2024-03-18T18:25:52.496669+0000","last_undegraded":"2024-03-18T18:25:52.496669+0000","last_fullsized":"2024-03-18T18:25:52.496669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4044","last_scrub_stamp":"2024-03-18T18:25:52.496642+0000","last_deep_scrub":"56'4044","last_deep_scrub_stamp":"2024-03-18T18:25:52.496642+0000","last_clean_scrub_stamp":"2024-03-18T18:25:52.496642+0000","objects_scrubbed":4,"log_size":4044,"log_dups_size":0,"ondisk_log_size":4044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:01.118815+0000","scrub_duration":0.055416811000000003,"objects_trimmed":0,"snaptrim_duration":0.0035692929999999999,"stat_sum":{"num_bytes":4107,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"56'1441","reported_seq":1504,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.225181+0000","last_change":"2024-03-18T18:25:41.225345+0000","last_active":"2024-03-18T18:25:41.225181+0000","last_peered":"2024-03-18T18:25:41.225181+0000","last_clean":"2024-03-18T18:25:41.225181+0000","last_became_active":"2024-03-18T18:09:12.448800+0000","last_became_peered":"2024-03-18T18:09:12.448800+0000","last_unstale":"2024-03-18T18:25:41.225181+0000","last_undegraded":"2024-03-18T18:25:41.225181+0000","last_fullsized":"2024-03-18T18:25:41.225181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1441","last_scrub_stamp":"2024-03-18T18:25:41.225139+0000","last_deep_scrub":"56'1441","last_deep_scrub_stamp":"2024-03-18T18:25:41.225139+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.225139+0000","objects_scrubbed":2,"log_size":1441,"log_dups_size":0,"ondisk_log_size":1441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:00:20.198746+0000","scrub_duration":0.033432481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":1534,"num_write_kb":17652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"54'3624","reported_seq":2995,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.809478+0000","last_change":"2024-03-18T18:25:59.809603+0000","last_active":"2024-03-18T18:25:59.809478+0000","last_peered":"2024-03-18T18:25:59.809478+0000","last_clean":"2024-03-18T18:25:59.809478+0000","last_became_active":"2024-03-18T18:09:12.838894+0000","last_became_peered":"2024-03-18T18:09:12.838894+0000","last_unstale":"2024-03-18T18:25:59.809478+0000","last_undegraded":"2024-03-18T18:25:59.809478+0000","last_fullsized":"2024-03-18T18:25:59.809478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3624","last_scrub_stamp":"2024-03-18T18:25:59.809455+0000","last_deep_scrub":"54'3624","last_deep_scrub_stamp":"2024-03-18T18:25:59.809455+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.809455+0000","objects_scrubbed":0,"log_size":3624,"log_dups_size":0,"ondisk_log_size":3624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:04:29.317286+0000","scrub_duration":0.036057659999999998,"objects_trimmed":0,"snaptrim_duration":0.055643589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"56'3529","reported_seq":3592,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.844515+0000","last_change":"2024-03-18T18:25:43.844735+0000","last_active":"2024-03-18T18:25:43.844515+0000","last_peered":"2024-03-18T18:25:43.844515+0000","last_clean":"2024-03-18T18:25:43.844515+0000","last_became_active":"2024-03-18T18:09:12.447724+0000","last_became_peered":"2024-03-18T18:09:12.447724+0000","last_unstale":"2024-03-18T18:25:43.844515+0000","last_undegraded":"2024-03-18T18:25:43.844515+0000","last_fullsized":"2024-03-18T18:25:43.844515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3529","last_scrub_stamp":"2024-03-18T18:25:43.844458+0000","last_deep_scrub":"56'3529","last_deep_scrub_stamp":"2024-03-18T18:25:43.844458+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.844458+0000","objects_scrubbed":2,"log_size":3529,"log_dups_size":0,"ondisk_log_size":3529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:01:59.288139+0000","scrub_duration":0.048300498999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":3618,"num_write_kb":34674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"56'682","reported_seq":746,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:45.126364+0000","last_change":"2024-03-18T18:25:45.126364+0000","last_active":"2024-03-18T18:25:45.126364+0000","last_peered":"2024-03-18T18:25:45.126364+0000","last_clean":"2024-03-18T18:25:45.126364+0000","last_became_active":"2024-03-18T18:09:12.445278+0000","last_became_peered":"2024-03-18T18:09:12.445278+0000","last_unstale":"2024-03-18T18:25:45.126364+0000","last_undegraded":"2024-03-18T18:25:45.126364+0000","last_fullsized":"2024-03-18T18:25:45.126364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'682","last_scrub_stamp":"2024-03-18T18:25:45.126076+0000","last_deep_scrub":"56'682","last_deep_scrub_stamp":"2024-03-18T18:25:45.126076+0000","last_clean_scrub_stamp":"2024-03-18T18:25:45.126076+0000","objects_scrubbed":3,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:19.202685+0000","scrub_duration":0.033214492999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":747,"num_write_kb":13015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"56'4462","reported_seq":3649,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:12.089969+0000","last_change":"2024-03-18T18:26:12.090327+0000","last_active":"2024-03-18T18:26:12.089969+0000","last_peered":"2024-03-18T18:26:12.089969+0000","last_clean":"2024-03-18T18:26:12.089969+0000","last_became_active":"2024-03-18T18:09:12.828361+0000","last_became_peered":"2024-03-18T18:09:12.828361+0000","last_unstale":"2024-03-18T18:26:12.089969+0000","last_undegraded":"2024-03-18T18:26:12.089969+0000","last_fullsized":"2024-03-18T18:26:12.089969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4462","last_scrub_stamp":"2024-03-18T18:26:12.089892+0000","last_deep_scrub":"56'4462","last_deep_scrub_stamp":"2024-03-18T18:26:12.089892+0000","last_clean_scrub_stamp":"2024-03-18T18:26:12.089892+0000","objects_scrubbed":1,"log_size":4462,"log_dups_size":0,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:08:14.027565+0000","scrub_duration":0.043130329000000002,"objects_trimmed":0,"snaptrim_duration":0.012562408000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"56'5550","reported_seq":5614,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.516523+0000","last_change":"2024-03-18T18:25:47.516523+0000","last_active":"2024-03-18T18:25:47.516523+0000","last_peered":"2024-03-18T18:25:47.516523+0000","last_clean":"2024-03-18T18:25:47.516523+0000","last_became_active":"2024-03-18T18:09:12.451125+0000","last_became_peered":"2024-03-18T18:09:12.451125+0000","last_unstale":"2024-03-18T18:25:47.516523+0000","last_undegraded":"2024-03-18T18:25:47.516523+0000","last_fullsized":"2024-03-18T18:25:47.516523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5550","last_scrub_stamp":"2024-03-18T18:25:47.516294+0000","last_deep_scrub":"56'5550","last_deep_scrub_stamp":"2024-03-18T18:25:47.516294+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.516294+0000","objects_scrubbed":4,"log_size":5550,"log_dups_size":0,"ondisk_log_size":5550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:33:26.469138+0000","scrub_duration":0.092072492000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":5631,"num_write_kb":39897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"56'3915","reported_seq":3253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:16.204090+0000","last_change":"2024-03-18T18:26:16.204356+0000","last_active":"2024-03-18T18:26:16.204090+0000","last_peered":"2024-03-18T18:26:16.204090+0000","last_clean":"2024-03-18T18:26:16.204090+0000","last_became_active":"2024-03-18T18:09:12.824453+0000","last_became_peered":"2024-03-18T18:09:12.824453+0000","last_unstale":"2024-03-18T18:26:16.204090+0000","last_undegraded":"2024-03-18T18:26:16.204090+0000","last_fullsized":"2024-03-18T18:26:16.204090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3915","last_scrub_stamp":"2024-03-18T18:26:16.204032+0000","last_deep_scrub":"56'3915","last_deep_scrub_stamp":"2024-03-18T18:26:16.204032+0000","last_clean_scrub_stamp":"2024-03-18T18:26:16.204032+0000","objects_scrubbed":4,"log_size":3915,"log_dups_size":0,"ondisk_log_size":3915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:49.739786+0000","scrub_duration":0.044722550999999999,"objects_trimmed":0,"snaptrim_duration":0.035022245,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"56'1870","reported_seq":1934,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:45.861089+0000","last_change":"2024-03-18T18:25:45.861089+0000","last_active":"2024-03-18T18:25:45.861089+0000","last_peered":"2024-03-18T18:25:45.861089+0000","last_clean":"2024-03-18T18:25:45.861089+0000","last_became_active":"2024-03-18T18:09:12.454738+0000","last_became_peered":"2024-03-18T18:09:12.454738+0000","last_unstale":"2024-03-18T18:25:45.861089+0000","last_undegraded":"2024-03-18T18:25:45.861089+0000","last_fullsized":"2024-03-18T18:25:45.861089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1870","last_scrub_stamp":"2024-03-18T18:25:45.860770+0000","last_deep_scrub":"56'1870","last_deep_scrub_stamp":"2024-03-18T18:25:45.860770+0000","last_clean_scrub_stamp":"2024-03-18T18:25:45.860770+0000","objects_scrubbed":6,"log_size":1870,"log_dups_size":0,"ondisk_log_size":1870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T04:28:25.178558+0000","scrub_duration":0.078756888999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18032374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1972,"num_write_kb":19324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"56'3673","reported_seq":3096,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:18.575823+0000","last_change":"2024-03-18T18:26:18.576108+0000","last_active":"2024-03-18T18:26:18.575823+0000","last_peered":"2024-03-18T18:26:18.575823+0000","last_clean":"2024-03-18T18:26:18.575823+0000","last_became_active":"2024-03-18T18:09:12.842849+0000","last_became_peered":"2024-03-18T18:09:12.842849+0000","last_unstale":"2024-03-18T18:26:18.575823+0000","last_undegraded":"2024-03-18T18:26:18.575823+0000","last_fullsized":"2024-03-18T18:26:18.575823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3673","last_scrub_stamp":"2024-03-18T18:26:18.575767+0000","last_deep_scrub":"56'3673","last_deep_scrub_stamp":"2024-03-18T18:26:18.575767+0000","last_clean_scrub_stamp":"2024-03-18T18:26:18.575767+0000","objects_scrubbed":4,"log_size":3673,"log_dups_size":0,"ondisk_log_size":3673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:29:17.022266+0000","scrub_duration":0.044973614000000002,"objects_trimmed":0,"snaptrim_duration":0.024265089,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"56'2296","reported_seq":2360,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.484347+0000","last_change":"2024-03-18T18:25:41.484347+0000","last_active":"2024-03-18T18:25:41.484347+0000","last_peered":"2024-03-18T18:25:41.484347+0000","last_clean":"2024-03-18T18:25:41.484347+0000","last_became_active":"2024-03-18T18:09:12.450584+0000","last_became_peered":"2024-03-18T18:09:12.450584+0000","last_unstale":"2024-03-18T18:25:41.484347+0000","last_undegraded":"2024-03-18T18:25:41.484347+0000","last_fullsized":"2024-03-18T18:25:41.484347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2296","last_scrub_stamp":"2024-03-18T18:25:41.483991+0000","last_deep_scrub":"56'2296","last_deep_scrub_stamp":"2024-03-18T18:25:41.483991+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.483991+0000","objects_scrubbed":3,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.106164+0000","scrub_duration":0.040176058000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":2432,"num_write_kb":26779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1144,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"56'3706","reported_seq":3087,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:52.814394+0000","last_change":"2024-03-18T18:25:52.814394+0000","last_active":"2024-03-18T18:25:52.814394+0000","last_peered":"2024-03-18T18:25:52.814394+0000","last_clean":"2024-03-18T18:25:52.814394+0000","last_became_active":"2024-03-18T18:09:12.850317+0000","last_became_peered":"2024-03-18T18:09:12.850317+0000","last_unstale":"2024-03-18T18:25:52.814394+0000","last_undegraded":"2024-03-18T18:25:52.814394+0000","last_fullsized":"2024-03-18T18:25:52.814394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3706","last_scrub_stamp":"2024-03-18T18:25:52.814198+0000","last_deep_scrub":"56'3706","last_deep_scrub_stamp":"2024-03-18T18:25:52.814198+0000","last_clean_scrub_stamp":"2024-03-18T18:25:52.814198+0000","objects_scrubbed":2,"log_size":3706,"log_dups_size":0,"ondisk_log_size":3706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:59:43.699712+0000","scrub_duration":0.039535882000000001,"objects_trimmed":0,"snaptrim_duration":0.049176324,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"56'2697","reported_seq":2761,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:00.070619+0000","last_change":"2024-03-18T18:26:00.070619+0000","last_active":"2024-03-18T18:26:00.070619+0000","last_peered":"2024-03-18T18:26:00.070619+0000","last_clean":"2024-03-18T18:26:00.070619+0000","last_became_active":"2024-03-18T18:09:12.452467+0000","last_became_peered":"2024-03-18T18:09:12.452467+0000","last_unstale":"2024-03-18T18:26:00.070619+0000","last_undegraded":"2024-03-18T18:26:00.070619+0000","last_fullsized":"2024-03-18T18:26:00.070619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2697","last_scrub_stamp":"2024-03-18T18:26:00.070324+0000","last_deep_scrub":"56'2697","last_deep_scrub_stamp":"2024-03-18T18:26:00.070324+0000","last_clean_scrub_stamp":"2024-03-18T18:26:00.070324+0000","objects_scrubbed":3,"log_size":2697,"log_dups_size":0,"ondisk_log_size":2697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:14:02.648229+0000","scrub_duration":0.042248144000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2797,"num_write_kb":22521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'3879","reported_seq":3253,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:50.521236+0000","last_change":"2024-03-18T18:25:50.521386+0000","last_active":"2024-03-18T18:25:50.521236+0000","last_peered":"2024-03-18T18:25:50.521236+0000","last_clean":"2024-03-18T18:25:50.521236+0000","last_became_active":"2024-03-18T18:09:12.836528+0000","last_became_peered":"2024-03-18T18:09:12.836528+0000","last_unstale":"2024-03-18T18:25:50.521236+0000","last_undegraded":"2024-03-18T18:25:50.521236+0000","last_fullsized":"2024-03-18T18:25:50.521236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3879","last_scrub_stamp":"2024-03-18T18:25:50.521213+0000","last_deep_scrub":"56'3879","last_deep_scrub_stamp":"2024-03-18T18:25:50.521213+0000","last_clean_scrub_stamp":"2024-03-18T18:25:50.521213+0000","objects_scrubbed":3,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:25.096813+0000","scrub_duration":0.051826733,"objects_trimmed":0,"snaptrim_duration":0.0058024840000000001,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":1256,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"56'3875","reported_seq":3939,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.986624+0000","last_change":"2024-03-18T18:25:59.986799+0000","last_active":"2024-03-18T18:25:59.986624+0000","last_peered":"2024-03-18T18:25:59.986624+0000","last_clean":"2024-03-18T18:25:59.986624+0000","last_became_active":"2024-03-18T18:09:12.448136+0000","last_became_peered":"2024-03-18T18:09:12.448136+0000","last_unstale":"2024-03-18T18:25:59.986624+0000","last_undegraded":"2024-03-18T18:25:59.986624+0000","last_fullsized":"2024-03-18T18:25:59.986624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3875","last_scrub_stamp":"2024-03-18T18:25:59.986592+0000","last_deep_scrub":"56'3875","last_deep_scrub_stamp":"2024-03-18T18:25:59.986592+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.986592+0000","objects_scrubbed":6,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:24:59.170445+0000","scrub_duration":0.058570773999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":3979,"num_write_kb":30875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"56'3914","reported_seq":3226,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:33.301992+0000","last_change":"2024-03-18T18:26:33.302191+0000","last_active":"2024-03-18T18:26:33.301992+0000","last_peered":"2024-03-18T18:26:33.301992+0000","last_clean":"2024-03-18T18:26:33.301992+0000","last_became_active":"2024-03-18T18:09:12.830566+0000","last_became_peered":"2024-03-18T18:09:12.830566+0000","last_unstale":"2024-03-18T18:26:33.301992+0000","last_undegraded":"2024-03-18T18:26:33.301992+0000","last_fullsized":"2024-03-18T18:26:33.301992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3914","last_scrub_stamp":"2024-03-18T18:26:33.301939+0000","last_deep_scrub":"56'3914","last_deep_scrub_stamp":"2024-03-18T18:26:33.301939+0000","last_clean_scrub_stamp":"2024-03-18T18:26:33.301939+0000","objects_scrubbed":3,"log_size":3914,"log_dups_size":0,"ondisk_log_size":3914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:29:18.977151+0000","scrub_duration":0.050951176000000001,"objects_trimmed":0,"snaptrim_duration":0.007039544,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"56'2798","reported_seq":2862,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:42.717588+0000","last_change":"2024-03-18T18:25:42.717894+0000","last_active":"2024-03-18T18:25:42.717588+0000","last_peered":"2024-03-18T18:25:42.717588+0000","last_clean":"2024-03-18T18:25:42.717588+0000","last_became_active":"2024-03-18T18:09:12.441656+0000","last_became_peered":"2024-03-18T18:09:12.441656+0000","last_unstale":"2024-03-18T18:25:42.717588+0000","last_undegraded":"2024-03-18T18:25:42.717588+0000","last_fullsized":"2024-03-18T18:25:42.717588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2798","last_scrub_stamp":"2024-03-18T18:25:42.717503+0000","last_deep_scrub":"56'2798","last_deep_scrub_stamp":"2024-03-18T18:25:42.717503+0000","last_clean_scrub_stamp":"2024-03-18T18:25:42.717503+0000","objects_scrubbed":4,"log_size":2798,"log_dups_size":0,"ondisk_log_size":2798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:35:36.581172+0000","scrub_duration":0.050648071000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":2890,"num_write_kb":17958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5500,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"56'3873","reported_seq":3198,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:49.807272+0000","last_change":"2024-03-18T18:25:49.807385+0000","last_active":"2024-03-18T18:25:49.807272+0000","last_peered":"2024-03-18T18:25:49.807272+0000","last_clean":"2024-03-18T18:25:49.807272+0000","last_became_active":"2024-03-18T18:09:12.831322+0000","last_became_peered":"2024-03-18T18:09:12.831322+0000","last_unstale":"2024-03-18T18:25:49.807272+0000","last_undegraded":"2024-03-18T18:25:49.807272+0000","last_fullsized":"2024-03-18T18:25:49.807272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3873","last_scrub_stamp":"2024-03-18T18:25:49.807250+0000","last_deep_scrub":"56'3873","last_deep_scrub_stamp":"2024-03-18T18:25:49.807250+0000","last_clean_scrub_stamp":"2024-03-18T18:25:49.807250+0000","objects_scrubbed":3,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:08:26.538859+0000","scrub_duration":0.047405282999999999,"objects_trimmed":0,"snaptrim_duration":0.044042870999999997,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"56'150","reported_seq":214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:01.498268+0000","last_change":"2024-03-18T18:26:01.498448+0000","last_active":"2024-03-18T18:26:01.498268+0000","last_peered":"2024-03-18T18:26:01.498268+0000","last_clean":"2024-03-18T18:26:01.498268+0000","last_became_active":"2024-03-18T18:09:12.450963+0000","last_became_peered":"2024-03-18T18:09:12.450963+0000","last_unstale":"2024-03-18T18:26:01.498268+0000","last_undegraded":"2024-03-18T18:26:01.498268+0000","last_fullsized":"2024-03-18T18:26:01.498268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'150","last_scrub_stamp":"2024-03-18T18:26:01.498242+0000","last_deep_scrub":"56'150","last_deep_scrub_stamp":"2024-03-18T18:26:01.498242+0000","last_clean_scrub_stamp":"2024-03-18T18:26:01.498242+0000","objects_scrubbed":2,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:08.639424+0000","scrub_duration":0.016983127000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":278,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"54'4078","reported_seq":3420,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:18.370365+0000","last_change":"2024-03-18T18:26:18.370486+0000","last_active":"2024-03-18T18:26:18.370365+0000","last_peered":"2024-03-18T18:26:18.370365+0000","last_clean":"2024-03-18T18:26:18.370365+0000","last_became_active":"2024-03-18T18:09:12.839076+0000","last_became_peered":"2024-03-18T18:09:12.839076+0000","last_unstale":"2024-03-18T18:26:18.370365+0000","last_undegraded":"2024-03-18T18:26:18.370365+0000","last_fullsized":"2024-03-18T18:26:18.370365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4078","last_scrub_stamp":"2024-03-18T18:26:18.370343+0000","last_deep_scrub":"54'4078","last_deep_scrub_stamp":"2024-03-18T18:26:18.370343+0000","last_clean_scrub_stamp":"2024-03-18T18:26:18.370343+0000","objects_scrubbed":0,"log_size":4078,"log_dups_size":0,"ondisk_log_size":4078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:51.906097+0000","scrub_duration":0.036888690000000002,"objects_trimmed":0,"snaptrim_duration":0.0084811569999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"56'1129","reported_seq":1193,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:44.808254+0000","last_change":"2024-03-18T18:25:44.808524+0000","last_active":"2024-03-18T18:25:44.808254+0000","last_peered":"2024-03-18T18:25:44.808254+0000","last_clean":"2024-03-18T18:25:44.808254+0000","last_became_active":"2024-03-18T18:09:12.444902+0000","last_became_peered":"2024-03-18T18:09:12.444902+0000","last_unstale":"2024-03-18T18:25:44.808254+0000","last_undegraded":"2024-03-18T18:25:44.808254+0000","last_fullsized":"2024-03-18T18:25:44.808254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1129","last_scrub_stamp":"2024-03-18T18:25:44.808198+0000","last_deep_scrub":"56'1129","last_deep_scrub_stamp":"2024-03-18T18:25:44.808198+0000","last_clean_scrub_stamp":"2024-03-18T18:25:44.808198+0000","objects_scrubbed":2,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:59.462515+0000","scrub_duration":0.037470452000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":1207,"num_write_kb":9599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"56'3650","reported_seq":2987,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.060898+0000","last_change":"2024-03-18T18:26:06.061173+0000","last_active":"2024-03-18T18:26:06.060898+0000","last_peered":"2024-03-18T18:26:06.060898+0000","last_clean":"2024-03-18T18:26:06.060898+0000","last_became_active":"2024-03-18T18:09:12.846790+0000","last_became_peered":"2024-03-18T18:09:12.846790+0000","last_unstale":"2024-03-18T18:26:06.060898+0000","last_undegraded":"2024-03-18T18:26:06.060898+0000","last_fullsized":"2024-03-18T18:26:06.060898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3650","last_scrub_stamp":"2024-03-18T18:26:06.060873+0000","last_deep_scrub":"56'3650","last_deep_scrub_stamp":"2024-03-18T18:26:06.060873+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.060873+0000","objects_scrubbed":1,"log_size":3650,"log_dups_size":0,"ondisk_log_size":3650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:14:08.638778+0000","scrub_duration":0.042544116,"objects_trimmed":0,"snaptrim_duration":0.017244314,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"56'1557","reported_seq":1621,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.009218+0000","last_change":"2024-03-18T18:25:40.009370+0000","last_active":"2024-03-18T18:25:40.009218+0000","last_peered":"2024-03-18T18:25:40.009218+0000","last_clean":"2024-03-18T18:25:40.009218+0000","last_became_active":"2024-03-18T18:09:12.443724+0000","last_became_peered":"2024-03-18T18:09:12.443724+0000","last_unstale":"2024-03-18T18:25:40.009218+0000","last_undegraded":"2024-03-18T18:25:40.009218+0000","last_fullsized":"2024-03-18T18:25:40.009218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1557","last_scrub_stamp":"2024-03-18T18:25:40.009192+0000","last_deep_scrub":"56'1557","last_deep_scrub_stamp":"2024-03-18T18:25:40.009192+0000","last_clean_scrub_stamp":"2024-03-18T18:25:40.009192+0000","objects_scrubbed":6,"log_size":1557,"log_dups_size":0,"ondisk_log_size":1557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:16.766526+0000","scrub_duration":0.020714032,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1653,"num_write_kb":13388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"56'4136","reported_seq":3384,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:21.364859+0000","last_change":"2024-03-18T18:26:21.365006+0000","last_active":"2024-03-18T18:26:21.364859+0000","last_peered":"2024-03-18T18:26:21.364859+0000","last_clean":"2024-03-18T18:26:21.364859+0000","last_became_active":"2024-03-18T18:09:12.838379+0000","last_became_peered":"2024-03-18T18:09:12.838379+0000","last_unstale":"2024-03-18T18:26:21.364859+0000","last_undegraded":"2024-03-18T18:26:21.364859+0000","last_fullsized":"2024-03-18T18:26:21.364859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4136","last_scrub_stamp":"2024-03-18T18:26:21.364831+0000","last_deep_scrub":"56'4136","last_deep_scrub_stamp":"2024-03-18T18:26:21.364831+0000","last_clean_scrub_stamp":"2024-03-18T18:26:21.364831+0000","objects_scrubbed":3,"log_size":4136,"log_dups_size":0,"ondisk_log_size":4136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:15:26.097053+0000","scrub_duration":0.056418953000000001,"objects_trimmed":0,"snaptrim_duration":0.0070189859999999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"56'1390","reported_seq":1454,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.490628+0000","last_change":"2024-03-18T18:25:43.490805+0000","last_active":"2024-03-18T18:25:43.490628+0000","last_peered":"2024-03-18T18:25:43.490628+0000","last_clean":"2024-03-18T18:25:43.490628+0000","last_became_active":"2024-03-18T18:09:12.441350+0000","last_became_peered":"2024-03-18T18:09:12.441350+0000","last_unstale":"2024-03-18T18:25:43.490628+0000","last_undegraded":"2024-03-18T18:25:43.490628+0000","last_fullsized":"2024-03-18T18:25:43.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1390","last_scrub_stamp":"2024-03-18T18:25:43.490608+0000","last_deep_scrub":"56'1390","last_deep_scrub_stamp":"2024-03-18T18:25:43.490608+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.490608+0000","objects_scrubbed":2,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:38.146924+0000","scrub_duration":0.044349553999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":1499,"num_write_kb":13678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"56'3702","reported_seq":3058,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.208364+0000","last_change":"2024-03-18T18:25:41.208536+0000","last_active":"2024-03-18T18:25:41.208364+0000","last_peered":"2024-03-18T18:25:41.208364+0000","last_clean":"2024-03-18T18:25:41.208364+0000","last_became_active":"2024-03-18T18:09:12.838511+0000","last_became_peered":"2024-03-18T18:09:12.838511+0000","last_unstale":"2024-03-18T18:25:41.208364+0000","last_undegraded":"2024-03-18T18:25:41.208364+0000","last_fullsized":"2024-03-18T18:25:41.208364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3702","last_scrub_stamp":"2024-03-18T18:25:41.208326+0000","last_deep_scrub":"56'3702","last_deep_scrub_stamp":"2024-03-18T18:25:41.208326+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.208326+0000","objects_scrubbed":2,"log_size":3702,"log_dups_size":0,"ondisk_log_size":3702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:42.057439+0000","scrub_duration":0.048613747999999998,"objects_trimmed":0,"snaptrim_duration":0.0079090489999999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1222,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"56'1378","reported_seq":1442,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.908708+0000","last_change":"2024-03-18T18:25:43.908832+0000","last_active":"2024-03-18T18:25:43.908708+0000","last_peered":"2024-03-18T18:25:43.908708+0000","last_clean":"2024-03-18T18:25:43.908708+0000","last_became_active":"2024-03-18T18:09:12.445958+0000","last_became_peered":"2024-03-18T18:09:12.445958+0000","last_unstale":"2024-03-18T18:25:43.908708+0000","last_undegraded":"2024-03-18T18:25:43.908708+0000","last_fullsized":"2024-03-18T18:25:43.908708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1378","last_scrub_stamp":"2024-03-18T18:25:43.908685+0000","last_deep_scrub":"56'1378","last_deep_scrub_stamp":"2024-03-18T18:25:43.908685+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.908685+0000","objects_scrubbed":1,"log_size":1378,"log_dups_size":0,"ondisk_log_size":1378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:52.530858+0000","scrub_duration":0.016835227000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":1466,"num_write_kb":13293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"56'4068","reported_seq":3369,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.043897+0000","last_change":"2024-03-18T18:26:06.044430+0000","last_active":"2024-03-18T18:26:06.043897+0000","last_peered":"2024-03-18T18:26:06.043897+0000","last_clean":"2024-03-18T18:26:06.043897+0000","last_became_active":"2024-03-18T18:09:54.399466+0000","last_became_peered":"2024-03-18T18:09:54.399466+0000","last_unstale":"2024-03-18T18:26:06.043897+0000","last_undegraded":"2024-03-18T18:26:06.043897+0000","last_fullsized":"2024-03-18T18:26:06.043897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4068","last_scrub_stamp":"2024-03-18T18:26:06.043844+0000","last_deep_scrub":"56'4068","last_deep_scrub_stamp":"2024-03-18T18:26:06.043844+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.043844+0000","objects_scrubbed":3,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:40.265708+0000","scrub_duration":0.034103359999999999,"objects_trimmed":0,"snaptrim_duration":0.022020457,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"56'4631","reported_seq":4695,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:57.002010+0000","last_change":"2024-03-18T18:25:57.002379+0000","last_active":"2024-03-18T18:25:57.002010+0000","last_peered":"2024-03-18T18:25:57.002010+0000","last_clean":"2024-03-18T18:25:57.002010+0000","last_became_active":"2024-03-18T18:09:12.439723+0000","last_became_peered":"2024-03-18T18:09:12.439723+0000","last_unstale":"2024-03-18T18:25:57.002010+0000","last_undegraded":"2024-03-18T18:25:57.002010+0000","last_fullsized":"2024-03-18T18:25:57.002010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4631","last_scrub_stamp":"2024-03-18T18:25:57.001949+0000","last_deep_scrub":"56'4631","last_deep_scrub_stamp":"2024-03-18T18:25:57.001949+0000","last_clean_scrub_stamp":"2024-03-18T18:25:57.001949+0000","objects_scrubbed":2,"log_size":4631,"log_dups_size":0,"ondisk_log_size":4631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:31.223814+0000","scrub_duration":0.049250552000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":4738,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"54'3739","reported_seq":3075,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:20.582271+0000","last_change":"2024-03-18T18:26:20.582403+0000","last_active":"2024-03-18T18:26:20.582271+0000","last_peered":"2024-03-18T18:26:20.582271+0000","last_clean":"2024-03-18T18:26:20.582271+0000","last_became_active":"2024-03-18T18:09:12.834067+0000","last_became_peered":"2024-03-18T18:09:12.834067+0000","last_unstale":"2024-03-18T18:26:20.582271+0000","last_undegraded":"2024-03-18T18:26:20.582271+0000","last_fullsized":"2024-03-18T18:26:20.582271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3739","last_scrub_stamp":"2024-03-18T18:26:20.582247+0000","last_deep_scrub":"54'3739","last_deep_scrub_stamp":"2024-03-18T18:26:20.582247+0000","last_clean_scrub_stamp":"2024-03-18T18:26:20.582247+0000","objects_scrubbed":0,"log_size":3739,"log_dups_size":0,"ondisk_log_size":3739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:19:50.468023+0000","scrub_duration":0.040383333,"objects_trimmed":0,"snaptrim_duration":0.030106664000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"56'5041","reported_seq":5105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.017168+0000","last_change":"2024-03-18T18:25:46.017304+0000","last_active":"2024-03-18T18:25:46.017168+0000","last_peered":"2024-03-18T18:25:46.017168+0000","last_clean":"2024-03-18T18:25:46.017168+0000","last_became_active":"2024-03-18T18:09:12.451891+0000","last_became_peered":"2024-03-18T18:09:12.451891+0000","last_unstale":"2024-03-18T18:25:46.017168+0000","last_undegraded":"2024-03-18T18:25:46.017168+0000","last_fullsized":"2024-03-18T18:25:46.017168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5041","last_scrub_stamp":"2024-03-18T18:25:46.017144+0000","last_deep_scrub":"56'5041","last_deep_scrub_stamp":"2024-03-18T18:25:46.017144+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.017144+0000","objects_scrubbed":7,"log_size":5041,"log_dups_size":0,"ondisk_log_size":5041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:02:01.460825+0000","scrub_duration":0.095345580999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5131,"num_write_kb":32235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"56'3519","reported_seq":2911,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:25.341988+0000","last_change":"2024-03-18T18:26:25.342100+0000","last_active":"2024-03-18T18:26:25.341988+0000","last_peered":"2024-03-18T18:26:25.341988+0000","last_clean":"2024-03-18T18:26:25.341988+0000","last_became_active":"2024-03-18T18:09:54.408355+0000","last_became_peered":"2024-03-18T18:09:54.408355+0000","last_unstale":"2024-03-18T18:26:25.341988+0000","last_undegraded":"2024-03-18T18:26:25.341988+0000","last_fullsized":"2024-03-18T18:26:25.341988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3519","last_scrub_stamp":"2024-03-18T18:26:25.341967+0000","last_deep_scrub":"56'3519","last_deep_scrub_stamp":"2024-03-18T18:26:25.341967+0000","last_clean_scrub_stamp":"2024-03-18T18:26:25.341967+0000","objects_scrubbed":1,"log_size":3519,"log_dups_size":0,"ondisk_log_size":3519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:54:54.447192+0000","scrub_duration":0.034782436,"objects_trimmed":0,"snaptrim_duration":0.0078100699999999997,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"56'119","reported_seq":220,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:56.012960+0000","last_change":"2024-03-18T18:25:56.013101+0000","last_active":"2024-03-18T18:25:56.012960+0000","last_peered":"2024-03-18T18:25:56.012960+0000","last_clean":"2024-03-18T18:25:56.012960+0000","last_became_active":"2024-03-18T18:09:00.899728+0000","last_became_peered":"2024-03-18T18:09:00.899728+0000","last_unstale":"2024-03-18T18:25:56.012960+0000","last_undegraded":"2024-03-18T18:25:56.012960+0000","last_fullsized":"2024-03-18T18:25:56.012960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'119","last_scrub_stamp":"2024-03-18T18:25:56.012932+0000","last_deep_scrub":"56'119","last_deep_scrub_stamp":"2024-03-18T18:25:56.012932+0000","last_clean_scrub_stamp":"2024-03-18T18:25:56.012932+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:03.154114+0000","scrub_duration":0.016100778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"56'1923","reported_seq":1988,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:46.496148+0000","last_change":"2024-03-18T18:25:46.496148+0000","last_active":"2024-03-18T18:25:46.496148+0000","last_peered":"2024-03-18T18:25:46.496148+0000","last_clean":"2024-03-18T18:25:46.496148+0000","last_became_active":"2024-03-18T18:09:12.449841+0000","last_became_peered":"2024-03-18T18:09:12.449841+0000","last_unstale":"2024-03-18T18:25:46.496148+0000","last_undegraded":"2024-03-18T18:25:46.496148+0000","last_fullsized":"2024-03-18T18:25:46.496148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1923","last_scrub_stamp":"2024-03-18T18:25:46.495988+0000","last_deep_scrub":"56'1923","last_deep_scrub_stamp":"2024-03-18T18:25:46.495988+0000","last_clean_scrub_stamp":"2024-03-18T18:25:46.495988+0000","objects_scrubbed":3,"log_size":1923,"log_dups_size":0,"ondisk_log_size":1923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:01.150305+0000","scrub_duration":0.039538838999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1994,"num_write_kb":17881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"54'3732","reported_seq":3149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:55.069417+0000","last_change":"2024-03-18T18:25:55.069555+0000","last_active":"2024-03-18T18:25:55.069417+0000","last_peered":"2024-03-18T18:25:55.069417+0000","last_clean":"2024-03-18T18:25:55.069417+0000","last_became_active":"2024-03-18T18:09:12.849798+0000","last_became_peered":"2024-03-18T18:09:12.849798+0000","last_unstale":"2024-03-18T18:25:55.069417+0000","last_undegraded":"2024-03-18T18:25:55.069417+0000","last_fullsized":"2024-03-18T18:25:55.069417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3732","last_scrub_stamp":"2024-03-18T18:25:55.069397+0000","last_deep_scrub":"54'3732","last_deep_scrub_stamp":"2024-03-18T18:25:55.069397+0000","last_clean_scrub_stamp":"2024-03-18T18:25:55.069397+0000","objects_scrubbed":0,"log_size":3732,"log_dups_size":0,"ondisk_log_size":3732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:59:45.954910+0000","scrub_duration":0.034961982000000003,"objects_trimmed":0,"snaptrim_duration":0.012071264999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"56'4978","reported_seq":5043,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:59.167805+0000","last_change":"2024-03-18T18:25:59.167976+0000","last_active":"2024-03-18T18:25:59.167805+0000","last_peered":"2024-03-18T18:25:59.167805+0000","last_clean":"2024-03-18T18:25:59.167805+0000","last_became_active":"2024-03-18T18:09:12.449337+0000","last_became_peered":"2024-03-18T18:09:12.449337+0000","last_unstale":"2024-03-18T18:25:59.167805+0000","last_undegraded":"2024-03-18T18:25:59.167805+0000","last_fullsized":"2024-03-18T18:25:59.167805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4978","last_scrub_stamp":"2024-03-18T18:25:59.167781+0000","last_deep_scrub":"56'4978","last_deep_scrub_stamp":"2024-03-18T18:25:59.167781+0000","last_clean_scrub_stamp":"2024-03-18T18:25:59.167781+0000","objects_scrubbed":3,"log_size":4978,"log_dups_size":0,"ondisk_log_size":4978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:33.389646+0000","scrub_duration":0.048284953999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":5073,"num_write_kb":32093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"54'3549","reported_seq":2947,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.766358+0000","last_change":"2024-03-18T18:25:54.766577+0000","last_active":"2024-03-18T18:25:54.766358+0000","last_peered":"2024-03-18T18:25:54.766358+0000","last_clean":"2024-03-18T18:25:54.766358+0000","last_became_active":"2024-03-18T18:09:12.838707+0000","last_became_peered":"2024-03-18T18:09:12.838707+0000","last_unstale":"2024-03-18T18:25:54.766358+0000","last_undegraded":"2024-03-18T18:25:54.766358+0000","last_fullsized":"2024-03-18T18:25:54.766358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3549","last_scrub_stamp":"2024-03-18T18:25:54.766331+0000","last_deep_scrub":"54'3549","last_deep_scrub_stamp":"2024-03-18T18:25:54.766331+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.766331+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:13.460331+0000","scrub_duration":0.038148003999999999,"objects_trimmed":0,"snaptrim_duration":0.036976862999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"56'2670","reported_seq":3275,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.951311+0000","last_change":"2024-03-18T18:25:41.951311+0000","last_active":"2024-03-18T18:25:41.951311+0000","last_peered":"2024-03-18T18:25:41.951311+0000","last_clean":"2024-03-18T18:25:41.951311+0000","last_became_active":"2024-03-18T18:09:12.445931+0000","last_became_peered":"2024-03-18T18:09:12.445931+0000","last_unstale":"2024-03-18T18:25:41.951311+0000","last_undegraded":"2024-03-18T18:25:41.951311+0000","last_fullsized":"2024-03-18T18:25:41.951311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2670","last_scrub_stamp":"2024-03-18T18:25:41.950936+0000","last_deep_scrub":"56'2670","last_deep_scrub_stamp":"2024-03-18T18:25:41.950936+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.950936+0000","objects_scrubbed":2,"log_size":2670,"log_dups_size":0,"ondisk_log_size":2670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:16.526536+0000","scrub_duration":0.038474542,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7880745,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":3954,"num_write":2780,"num_write_kb":22175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"56'4237","reported_seq":3498,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.108085+0000","last_change":"2024-03-18T18:26:04.108204+0000","last_active":"2024-03-18T18:26:04.108085+0000","last_peered":"2024-03-18T18:26:04.108085+0000","last_clean":"2024-03-18T18:26:04.108085+0000","last_became_active":"2024-03-18T18:09:12.822450+0000","last_became_peered":"2024-03-18T18:09:12.822450+0000","last_unstale":"2024-03-18T18:26:04.108085+0000","last_undegraded":"2024-03-18T18:26:04.108085+0000","last_fullsized":"2024-03-18T18:26:04.108085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4237","last_scrub_stamp":"2024-03-18T18:26:04.108063+0000","last_deep_scrub":"56'4237","last_deep_scrub_stamp":"2024-03-18T18:26:04.108063+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.108063+0000","objects_scrubbed":2,"log_size":4237,"log_dups_size":0,"ondisk_log_size":4237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:50:56.604412+0000","scrub_duration":0.031818854000000001,"objects_trimmed":0,"snaptrim_duration":0.034813987999999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1234,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"56'5926","reported_seq":5991,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:48.541126+0000","last_change":"2024-03-18T18:25:48.541126+0000","last_active":"2024-03-18T18:25:48.541126+0000","last_peered":"2024-03-18T18:25:48.541126+0000","last_clean":"2024-03-18T18:25:48.541126+0000","last_became_active":"2024-03-18T18:09:12.450450+0000","last_became_peered":"2024-03-18T18:09:12.450450+0000","last_unstale":"2024-03-18T18:25:48.541126+0000","last_undegraded":"2024-03-18T18:25:48.541126+0000","last_fullsized":"2024-03-18T18:25:48.541126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'5926","last_scrub_stamp":"2024-03-18T18:25:48.540811+0000","last_deep_scrub":"56'5926","last_deep_scrub_stamp":"2024-03-18T18:25:48.540811+0000","last_clean_scrub_stamp":"2024-03-18T18:25:48.540811+0000","objects_scrubbed":6,"log_size":5926,"log_dups_size":0,"ondisk_log_size":5926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:28:42.884022+0000","scrub_duration":0.085163540999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":6010,"num_write_kb":44179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"54'3976","reported_seq":3265,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.457689+0000","last_change":"2024-03-18T18:25:54.457689+0000","last_active":"2024-03-18T18:25:54.457689+0000","last_peered":"2024-03-18T18:25:54.457689+0000","last_clean":"2024-03-18T18:25:54.457689+0000","last_became_active":"2024-03-18T18:09:12.834015+0000","last_became_peered":"2024-03-18T18:09:12.834015+0000","last_unstale":"2024-03-18T18:25:54.457689+0000","last_undegraded":"2024-03-18T18:25:54.457689+0000","last_fullsized":"2024-03-18T18:25:54.457689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3976","last_scrub_stamp":"2024-03-18T18:25:54.457559+0000","last_deep_scrub":"54'3976","last_deep_scrub_stamp":"2024-03-18T18:25:54.457559+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.457559+0000","objects_scrubbed":0,"log_size":3976,"log_dups_size":0,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:02:09.901240+0000","scrub_duration":0.040947814999999999,"objects_trimmed":0,"snaptrim_duration":0.0052776710000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"56'956","reported_seq":1021,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.069999+0000","last_change":"2024-03-18T18:25:41.069999+0000","last_active":"2024-03-18T18:25:41.069999+0000","last_peered":"2024-03-18T18:25:41.069999+0000","last_clean":"2024-03-18T18:25:41.069999+0000","last_became_active":"2024-03-18T18:09:12.441294+0000","last_became_peered":"2024-03-18T18:09:12.441294+0000","last_unstale":"2024-03-18T18:25:41.069999+0000","last_undegraded":"2024-03-18T18:25:41.069999+0000","last_fullsized":"2024-03-18T18:25:41.069999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'956","last_scrub_stamp":"2024-03-18T18:25:41.069763+0000","last_deep_scrub":"56'956","last_deep_scrub_stamp":"2024-03-18T18:25:41.069763+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.069763+0000","objects_scrubbed":3,"log_size":956,"log_dups_size":0,"ondisk_log_size":956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:28:35.412974+0000","scrub_duration":0.031375185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1029,"num_write_kb":13555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"56'3618","reported_seq":3025,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.469717+0000","last_change":"2024-03-18T18:26:04.470040+0000","last_active":"2024-03-18T18:26:04.469717+0000","last_peered":"2024-03-18T18:26:04.469717+0000","last_clean":"2024-03-18T18:26:04.469717+0000","last_became_active":"2024-03-18T18:09:12.842599+0000","last_became_peered":"2024-03-18T18:09:12.842599+0000","last_unstale":"2024-03-18T18:26:04.469717+0000","last_undegraded":"2024-03-18T18:26:04.469717+0000","last_fullsized":"2024-03-18T18:26:04.469717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3618","last_scrub_stamp":"2024-03-18T18:26:04.469643+0000","last_deep_scrub":"56'3618","last_deep_scrub_stamp":"2024-03-18T18:26:04.469643+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.469643+0000","objects_scrubbed":3,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:38.691508+0000","scrub_duration":0.055161114999999997,"objects_trimmed":0,"snaptrim_duration":0.033877880999999999,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"56'3705","reported_seq":3770,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.139105+0000","last_change":"2024-03-18T18:26:06.139229+0000","last_active":"2024-03-18T18:26:06.139105+0000","last_peered":"2024-03-18T18:26:06.139105+0000","last_clean":"2024-03-18T18:26:06.139105+0000","last_became_active":"2024-03-18T18:09:12.450849+0000","last_became_peered":"2024-03-18T18:09:12.450849+0000","last_unstale":"2024-03-18T18:26:06.139105+0000","last_undegraded":"2024-03-18T18:26:06.139105+0000","last_fullsized":"2024-03-18T18:26:06.139105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3705","last_scrub_stamp":"2024-03-18T18:26:06.139083+0000","last_deep_scrub":"56'3705","last_deep_scrub_stamp":"2024-03-18T18:26:06.139083+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.139083+0000","objects_scrubbed":1,"log_size":3705,"log_dups_size":0,"ondisk_log_size":3705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:50:58.635432+0000","scrub_duration":0.032071388999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":3828,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"54'3803","reported_seq":3200,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:09.144752+0000","last_change":"2024-03-18T18:26:09.144900+0000","last_active":"2024-03-18T18:26:09.144752+0000","last_peered":"2024-03-18T18:26:09.144752+0000","last_clean":"2024-03-18T18:26:09.144752+0000","last_became_active":"2024-03-18T18:09:12.821695+0000","last_became_peered":"2024-03-18T18:09:12.821695+0000","last_unstale":"2024-03-18T18:26:09.144752+0000","last_undegraded":"2024-03-18T18:26:09.144752+0000","last_fullsized":"2024-03-18T18:26:09.144752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3803","last_scrub_stamp":"2024-03-18T18:26:09.144731+0000","last_deep_scrub":"54'3803","last_deep_scrub_stamp":"2024-03-18T18:26:09.144731+0000","last_clean_scrub_stamp":"2024-03-18T18:26:09.144731+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:11.128772+0000","scrub_duration":0.032417933000000003,"objects_trimmed":0,"snaptrim_duration":0.042592734,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"56'2149","reported_seq":2214,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:54.106218+0000","last_change":"2024-03-18T18:25:54.106218+0000","last_active":"2024-03-18T18:25:54.106218+0000","last_peered":"2024-03-18T18:25:54.106218+0000","last_clean":"2024-03-18T18:25:54.106218+0000","last_became_active":"2024-03-18T18:09:12.448154+0000","last_became_peered":"2024-03-18T18:09:12.448154+0000","last_unstale":"2024-03-18T18:25:54.106218+0000","last_undegraded":"2024-03-18T18:25:54.106218+0000","last_fullsized":"2024-03-18T18:25:54.106218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2149","last_scrub_stamp":"2024-03-18T18:25:54.105980+0000","last_deep_scrub":"56'2149","last_deep_scrub_stamp":"2024-03-18T18:25:54.105980+0000","last_clean_scrub_stamp":"2024-03-18T18:25:54.105980+0000","objects_scrubbed":5,"log_size":2149,"log_dups_size":0,"ondisk_log_size":2149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:08:01.247163+0000","scrub_duration":0.135641664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":2527,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"54'3397","reported_seq":2827,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.120619+0000","last_change":"2024-03-18T18:26:11.120619+0000","last_active":"2024-03-18T18:26:11.120619+0000","last_peered":"2024-03-18T18:26:11.120619+0000","last_clean":"2024-03-18T18:26:11.120619+0000","last_became_active":"2024-03-18T18:09:12.832548+0000","last_became_peered":"2024-03-18T18:09:12.832548+0000","last_unstale":"2024-03-18T18:26:11.120619+0000","last_undegraded":"2024-03-18T18:26:11.120619+0000","last_fullsized":"2024-03-18T18:26:11.120619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'3397","last_scrub_stamp":"2024-03-18T18:26:11.120463+0000","last_deep_scrub":"54'3397","last_deep_scrub_stamp":"2024-03-18T18:26:11.120463+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.120463+0000","objects_scrubbed":0,"log_size":3397,"log_dups_size":0,"ondisk_log_size":3397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:22.172623+0000","scrub_duration":0.028029561000000001,"objects_trimmed":0,"snaptrim_duration":0.013158827,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"56'1822","reported_seq":1887,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:41.832792+0000","last_change":"2024-03-18T18:25:41.832792+0000","last_active":"2024-03-18T18:25:41.832792+0000","last_peered":"2024-03-18T18:25:41.832792+0000","last_clean":"2024-03-18T18:25:41.832792+0000","last_became_active":"2024-03-18T18:09:12.449980+0000","last_became_peered":"2024-03-18T18:09:12.449980+0000","last_unstale":"2024-03-18T18:25:41.832792+0000","last_undegraded":"2024-03-18T18:25:41.832792+0000","last_fullsized":"2024-03-18T18:25:41.832792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1822","last_scrub_stamp":"2024-03-18T18:25:41.832464+0000","last_deep_scrub":"56'1822","last_deep_scrub_stamp":"2024-03-18T18:25:41.832464+0000","last_clean_scrub_stamp":"2024-03-18T18:25:41.832464+0000","objects_scrubbed":2,"log_size":1822,"log_dups_size":0,"ondisk_log_size":1822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.454637+0000","scrub_duration":0.030830237999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1933,"num_write_kb":9867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"56'3545","reported_seq":2963,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:50.806580+0000","last_change":"2024-03-18T18:25:50.806580+0000","last_active":"2024-03-18T18:25:50.806580+0000","last_peered":"2024-03-18T18:25:50.806580+0000","last_clean":"2024-03-18T18:25:50.806580+0000","last_became_active":"2024-03-18T18:09:12.828744+0000","last_became_peered":"2024-03-18T18:09:12.828744+0000","last_unstale":"2024-03-18T18:25:50.806580+0000","last_undegraded":"2024-03-18T18:25:50.806580+0000","last_fullsized":"2024-03-18T18:25:50.806580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3545","last_scrub_stamp":"2024-03-18T18:25:50.806396+0000","last_deep_scrub":"56'3545","last_deep_scrub_stamp":"2024-03-18T18:25:50.806396+0000","last_clean_scrub_stamp":"2024-03-18T18:25:50.806396+0000","objects_scrubbed":5,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:11.869852+0000","scrub_duration":0.050638803000000003,"objects_trimmed":0,"snaptrim_duration":0.057395765000000001,"stat_sum":{"num_bytes":8201,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1142,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"56'1603","reported_seq":1668,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:17.309927+0000","last_change":"2024-03-18T18:26:17.309927+0000","last_active":"2024-03-18T18:26:17.309927+0000","last_peered":"2024-03-18T18:26:17.309927+0000","last_clean":"2024-03-18T18:26:17.309927+0000","last_became_active":"2024-03-18T18:09:12.449689+0000","last_became_peered":"2024-03-18T18:09:12.449689+0000","last_unstale":"2024-03-18T18:26:17.309927+0000","last_undegraded":"2024-03-18T18:26:17.309927+0000","last_fullsized":"2024-03-18T18:26:17.309927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1603","last_scrub_stamp":"2024-03-18T18:26:17.309379+0000","last_deep_scrub":"56'1603","last_deep_scrub_stamp":"2024-03-18T18:26:17.309379+0000","last_clean_scrub_stamp":"2024-03-18T18:26:17.309379+0000","objects_scrubbed":1,"log_size":1603,"log_dups_size":0,"ondisk_log_size":1603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:15:10.477824+0000","scrub_duration":0.025857398,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":1722,"num_write_kb":9733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"56'3744","reported_seq":3052,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:49.482819+0000","last_change":"2024-03-18T18:25:49.482819+0000","last_active":"2024-03-18T18:25:49.482819+0000","last_peered":"2024-03-18T18:25:49.482819+0000","last_clean":"2024-03-18T18:25:49.482819+0000","last_became_active":"2024-03-18T18:09:12.823787+0000","last_became_peered":"2024-03-18T18:09:12.823787+0000","last_unstale":"2024-03-18T18:25:49.482819+0000","last_undegraded":"2024-03-18T18:25:49.482819+0000","last_fullsized":"2024-03-18T18:25:49.482819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3744","last_scrub_stamp":"2024-03-18T18:25:49.482375+0000","last_deep_scrub":"56'3744","last_deep_scrub_stamp":"2024-03-18T18:25:49.482375+0000","last_clean_scrub_stamp":"2024-03-18T18:25:49.482375+0000","objects_scrubbed":1,"log_size":3744,"log_dups_size":0,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:26.239708+0000","scrub_duration":0.047960088999999997,"objects_trimmed":0,"snaptrim_duration":0.006382151,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"56'2480","reported_seq":2545,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:40.116493+0000","last_change":"2024-03-18T18:25:40.116493+0000","last_active":"2024-03-18T18:25:40.116493+0000","last_peered":"2024-03-18T18:25:40.116493+0000","last_clean":"2024-03-18T18:25:40.116493+0000","last_became_active":"2024-03-18T18:09:12.448629+0000","last_became_peered":"2024-03-18T18:09:12.448629+0000","last_unstale":"2024-03-18T18:25:40.116493+0000","last_undegraded":"2024-03-18T18:25:40.116493+0000","last_fullsized":"2024-03-18T18:25:40.116493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2480","last_scrub_stamp":"2024-03-18T18:25:40.116301+0000","last_deep_scrub":"56'2480","last_deep_scrub_stamp":"2024-03-18T18:25:40.116301+0000","last_clean_scrub_stamp":"2024-03-18T18:25:40.116301+0000","objects_scrubbed":2,"log_size":2480,"log_dups_size":0,"ondisk_log_size":2480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:33:19.069144+0000","scrub_duration":0.043506561999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":2596,"num_write_kb":18267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"56'4000","reported_seq":3342,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:51.142616+0000","last_change":"2024-03-18T18:25:51.142616+0000","last_active":"2024-03-18T18:25:51.142616+0000","last_peered":"2024-03-18T18:25:51.142616+0000","last_clean":"2024-03-18T18:25:51.142616+0000","last_became_active":"2024-03-18T18:09:12.828143+0000","last_became_peered":"2024-03-18T18:09:12.828143+0000","last_unstale":"2024-03-18T18:25:51.142616+0000","last_undegraded":"2024-03-18T18:25:51.142616+0000","last_fullsized":"2024-03-18T18:25:51.142616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4000","last_scrub_stamp":"2024-03-18T18:25:51.142454+0000","last_deep_scrub":"56'4000","last_deep_scrub_stamp":"2024-03-18T18:25:51.142454+0000","last_clean_scrub_stamp":"2024-03-18T18:25:51.142454+0000","objects_scrubbed":7,"log_size":4000,"log_dups_size":0,"ondisk_log_size":4000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:08:27.874062+0000","scrub_duration":0.071429648999999998,"objects_trimmed":0,"snaptrim_duration":0.014492592,"stat_sum":{"num_bytes":4128,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":2,"num_read_kb":1,"num_write":1228,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"56'2625","reported_seq":2690,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:39.120490+0000","last_change":"2024-03-18T18:25:39.120490+0000","last_active":"2024-03-18T18:25:39.120490+0000","last_peered":"2024-03-18T18:25:39.120490+0000","last_clean":"2024-03-18T18:25:39.120490+0000","last_became_active":"2024-03-18T18:09:12.445873+0000","last_became_peered":"2024-03-18T18:09:12.445873+0000","last_unstale":"2024-03-18T18:25:39.120490+0000","last_undegraded":"2024-03-18T18:25:39.120490+0000","last_fullsized":"2024-03-18T18:25:39.120490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'2625","last_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_deep_scrub":"56'2625","last_deep_scrub_stamp":"2024-03-18T18:25:39.120285+0000","last_clean_scrub_stamp":"2024-03-18T18:25:39.120285+0000","objects_scrubbed":3,"log_size":2625,"log_dups_size":0,"ondisk_log_size":2625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:27:53.774603+0000","scrub_duration":0.046006920999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":2711,"num_write_kb":30485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"56'3492","reported_seq":2928,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:13.077051+0000","last_change":"2024-03-18T18:26:13.077246+0000","last_active":"2024-03-18T18:26:13.077051+0000","last_peered":"2024-03-18T18:26:13.077051+0000","last_clean":"2024-03-18T18:26:13.077051+0000","last_became_active":"2024-03-18T18:09:12.831530+0000","last_became_peered":"2024-03-18T18:09:12.831530+0000","last_unstale":"2024-03-18T18:26:13.077051+0000","last_undegraded":"2024-03-18T18:26:13.077051+0000","last_fullsized":"2024-03-18T18:26:13.077051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3492","last_scrub_stamp":"2024-03-18T18:26:13.077012+0000","last_deep_scrub":"56'3492","last_deep_scrub_stamp":"2024-03-18T18:26:13.077012+0000","last_clean_scrub_stamp":"2024-03-18T18:26:13.077012+0000","objects_scrubbed":4,"log_size":3492,"log_dups_size":0,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:06:09.960717+0000","scrub_duration":0.044338466999999999,"objects_trimmed":0,"snaptrim_duration":0.013338991,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"56'4486","reported_seq":4550,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:02.255649+0000","last_change":"2024-03-18T18:26:02.255788+0000","last_active":"2024-03-18T18:26:02.255649+0000","last_peered":"2024-03-18T18:26:02.255649+0000","last_clean":"2024-03-18T18:26:02.255649+0000","last_became_active":"2024-03-18T18:09:12.450594+0000","last_became_peered":"2024-03-18T18:09:12.450594+0000","last_unstale":"2024-03-18T18:26:02.255649+0000","last_undegraded":"2024-03-18T18:26:02.255649+0000","last_fullsized":"2024-03-18T18:26:02.255649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'4486","last_scrub_stamp":"2024-03-18T18:26:02.255623+0000","last_deep_scrub":"56'4486","last_deep_scrub_stamp":"2024-03-18T18:26:02.255623+0000","last_clean_scrub_stamp":"2024-03-18T18:26:02.255623+0000","objects_scrubbed":3,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:27.313755+0000","scrub_duration":0.058791388999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":4579,"num_write_kb":31084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":402,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"56'3777","reported_seq":3149,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.057819+0000","last_change":"2024-03-18T18:26:04.057819+0000","last_active":"2024-03-18T18:26:04.057819+0000","last_peered":"2024-03-18T18:26:04.057819+0000","last_clean":"2024-03-18T18:26:04.057819+0000","last_became_active":"2024-03-18T18:09:12.842730+0000","last_became_peered":"2024-03-18T18:09:12.842730+0000","last_unstale":"2024-03-18T18:26:04.057819+0000","last_undegraded":"2024-03-18T18:26:04.057819+0000","last_fullsized":"2024-03-18T18:26:04.057819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3777","last_scrub_stamp":"2024-03-18T18:26:04.057685+0000","last_deep_scrub":"56'3777","last_deep_scrub_stamp":"2024-03-18T18:26:04.057685+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.057685+0000","objects_scrubbed":1,"log_size":3777,"log_dups_size":0,"ondisk_log_size":3777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:05:38.279550+0000","scrub_duration":0.037046915999999999,"objects_trimmed":0,"snaptrim_duration":0.015056361000000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"56'3711","reported_seq":3134,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.487655+0000","last_change":"2024-03-18T18:26:11.487809+0000","last_active":"2024-03-18T18:26:11.487655+0000","last_peered":"2024-03-18T18:26:11.487655+0000","last_clean":"2024-03-18T18:26:11.487655+0000","last_became_active":"2024-03-18T18:09:12.843174+0000","last_became_peered":"2024-03-18T18:09:12.843174+0000","last_unstale":"2024-03-18T18:26:11.487655+0000","last_undegraded":"2024-03-18T18:26:11.487655+0000","last_fullsized":"2024-03-18T18:26:11.487655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3711","last_scrub_stamp":"2024-03-18T18:26:11.487624+0000","last_deep_scrub":"56'3711","last_deep_scrub_stamp":"2024-03-18T18:26:11.487624+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.487624+0000","objects_scrubbed":1,"log_size":3711,"log_dups_size":0,"ondisk_log_size":3711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:51:21.988156+0000","scrub_duration":0.051621667000000003,"objects_trimmed":0,"snaptrim_duration":0.031664382999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"56'1390","reported_seq":1453,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:11.243471+0000","last_change":"2024-03-18T18:26:11.243680+0000","last_active":"2024-03-18T18:26:11.243471+0000","last_peered":"2024-03-18T18:26:11.243471+0000","last_clean":"2024-03-18T18:26:11.243471+0000","last_became_active":"2024-03-18T18:09:12.454778+0000","last_became_peered":"2024-03-18T18:09:12.454778+0000","last_unstale":"2024-03-18T18:26:11.243471+0000","last_undegraded":"2024-03-18T18:26:11.243471+0000","last_fullsized":"2024-03-18T18:26:11.243471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1390","last_scrub_stamp":"2024-03-18T18:26:11.243437+0000","last_deep_scrub":"56'1390","last_deep_scrub_stamp":"2024-03-18T18:26:11.243437+0000","last_clean_scrub_stamp":"2024-03-18T18:26:11.243437+0000","objects_scrubbed":3,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:11:13.227478+0000","scrub_duration":0.034684624999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1514,"num_write_kb":9729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"54'4103","reported_seq":3392,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:22.556148+0000","last_change":"2024-03-18T18:26:22.556287+0000","last_active":"2024-03-18T18:26:22.556148+0000","last_peered":"2024-03-18T18:26:22.556148+0000","last_clean":"2024-03-18T18:26:22.556148+0000","last_became_active":"2024-03-18T18:09:12.849026+0000","last_became_peered":"2024-03-18T18:09:12.849026+0000","last_unstale":"2024-03-18T18:26:22.556148+0000","last_undegraded":"2024-03-18T18:26:22.556148+0000","last_fullsized":"2024-03-18T18:26:22.556148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'4103","last_scrub_stamp":"2024-03-18T18:26:22.556128+0000","last_deep_scrub":"54'4103","last_deep_scrub_stamp":"2024-03-18T18:26:22.556128+0000","last_clean_scrub_stamp":"2024-03-18T18:26:22.556128+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:13.146667+0000","scrub_duration":0.044501935999999999,"objects_trimmed":0,"snaptrim_duration":0.029441169999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1281,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"56'3533","reported_seq":3596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:12.281520+0000","last_change":"2024-03-18T18:26:12.281695+0000","last_active":"2024-03-18T18:26:12.281520+0000","last_peered":"2024-03-18T18:26:12.281520+0000","last_clean":"2024-03-18T18:26:12.281520+0000","last_became_active":"2024-03-18T18:09:12.452501+0000","last_became_peered":"2024-03-18T18:09:12.452501+0000","last_unstale":"2024-03-18T18:26:12.281520+0000","last_undegraded":"2024-03-18T18:26:12.281520+0000","last_fullsized":"2024-03-18T18:26:12.281520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3533","last_scrub_stamp":"2024-03-18T18:26:12.281491+0000","last_deep_scrub":"56'3533","last_deep_scrub_stamp":"2024-03-18T18:26:12.281491+0000","last_clean_scrub_stamp":"2024-03-18T18:26:12.281491+0000","objects_scrubbed":3,"log_size":3533,"log_dups_size":0,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:53:21.406695+0000","scrub_duration":0.049874452,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":3604,"num_write_kb":34945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"56'3442","reported_seq":2908,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:06.857648+0000","last_change":"2024-03-18T18:26:06.857820+0000","last_active":"2024-03-18T18:26:06.857648+0000","last_peered":"2024-03-18T18:26:06.857648+0000","last_clean":"2024-03-18T18:26:06.857648+0000","last_became_active":"2024-03-18T18:09:12.850269+0000","last_became_peered":"2024-03-18T18:09:12.850269+0000","last_unstale":"2024-03-18T18:26:06.857648+0000","last_undegraded":"2024-03-18T18:26:06.857648+0000","last_fullsized":"2024-03-18T18:26:06.857648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3442","last_scrub_stamp":"2024-03-18T18:26:06.857614+0000","last_deep_scrub":"56'3442","last_deep_scrub_stamp":"2024-03-18T18:26:06.857614+0000","last_clean_scrub_stamp":"2024-03-18T18:26:06.857614+0000","objects_scrubbed":1,"log_size":3442,"log_dups_size":0,"ondisk_log_size":3442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:17.909774+0000","scrub_duration":0.025994977999999998,"objects_trimmed":0,"snaptrim_duration":0.047763052,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"56'3383","reported_seq":3448,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:47.104229+0000","last_change":"2024-03-18T18:25:47.104361+0000","last_active":"2024-03-18T18:25:47.104229+0000","last_peered":"2024-03-18T18:25:47.104229+0000","last_clean":"2024-03-18T18:25:47.104229+0000","last_became_active":"2024-03-18T18:09:12.443072+0000","last_became_peered":"2024-03-18T18:09:12.443072+0000","last_unstale":"2024-03-18T18:25:47.104229+0000","last_undegraded":"2024-03-18T18:25:47.104229+0000","last_fullsized":"2024-03-18T18:25:47.104229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3383","last_scrub_stamp":"2024-03-18T18:25:47.104205+0000","last_deep_scrub":"56'3383","last_deep_scrub_stamp":"2024-03-18T18:25:47.104205+0000","last_clean_scrub_stamp":"2024-03-18T18:25:47.104205+0000","objects_scrubbed":1,"log_size":3383,"log_dups_size":0,"ondisk_log_size":3383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:22.274913+0000","scrub_duration":0.034214560999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":3494,"num_write_kb":30890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"56'3369","reported_seq":2800,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:26:04.003005+0000","last_change":"2024-03-18T18:26:04.003288+0000","last_active":"2024-03-18T18:26:04.003005+0000","last_peered":"2024-03-18T18:26:04.003005+0000","last_clean":"2024-03-18T18:26:04.003005+0000","last_became_active":"2024-03-18T18:09:12.849005+0000","last_became_peered":"2024-03-18T18:09:12.849005+0000","last_unstale":"2024-03-18T18:26:04.003005+0000","last_undegraded":"2024-03-18T18:26:04.003005+0000","last_fullsized":"2024-03-18T18:26:04.003005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3369","last_scrub_stamp":"2024-03-18T18:26:04.002951+0000","last_deep_scrub":"56'3369","last_deep_scrub_stamp":"2024-03-18T18:26:04.002951+0000","last_clean_scrub_stamp":"2024-03-18T18:26:04.002951+0000","objects_scrubbed":1,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:04:33.510782+0000","scrub_duration":0.044972314999999999,"objects_trimmed":0,"snaptrim_duration":0.013145311999999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"56'1531","reported_seq":1596,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-03-18T18:25:43.745557+0000","last_change":"2024-03-18T18:25:43.745557+0000","last_active":"2024-03-18T18:25:43.745557+0000","last_peered":"2024-03-18T18:25:43.745557+0000","last_clean":"2024-03-18T18:25:43.745557+0000","last_became_active":"2024-03-18T18:09:12.448750+0000","last_became_peered":"2024-03-18T18:09:12.448750+0000","last_unstale":"2024-03-18T18:25:43.745557+0000","last_undegraded":"2024-03-18T18:25:43.745557+0000","last_fullsized":"2024-03-18T18:25:43.745557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'1531","last_scrub_stamp":"2024-03-18T18:25:43.745375+0000","last_deep_scrub":"56'1531","last_deep_scrub_stamp":"2024-03-18T18:25:43.745375+0000","last_clean_scrub_stamp":"2024-03-18T18:25:43.745375+0000","objects_scrubbed":3,"log_size":1531,"log_dups_size":0,"ondisk_log_size":1531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T05:14:39.035373+0000","scrub_duration":0.036436525999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":1633,"num_write_kb":13980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25222,"num_omap_keys":49,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127188,"num_objects":127,"num_object_clones":28,"num_object_copies":254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":15,"num_read":31,"num_read_kb":21,"num_write":75039,"num_write_kb":40600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":254376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":242073,"ondisk_log_size":242073,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":264990062,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":1575,"num_read_kb":3954,"num_write":88599,"num_write_kb":695434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35843,"num_omap_keys":70,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":530046976,"data_stored":529980124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85174,"ondisk_log_size":85174,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476952,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":404728,"kb_used_data":66800,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":93967112,"statfs":{"total":96636764160,"available":96222322688,"internally_reserved":0,"allocated":68403200,"data_stored":68027641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":346028491},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.78800000000000003,"15min":0.73199999999999998},"min":{"1min":0.35599999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":13.092000000000001,"5min":13.092000000000001,"15min":13.092000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.087,"5min":0.78300000000000003,"15min":0.72399999999999998},"min":{"1min":0.33900000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":6.3760000000000003,"5min":6.3760000000000003,"15min":6.3760000000000003},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.206,"5min":3.0449999999999999,"15min":4.8769999999999998},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.73999999999999999,"15min":0.79900000000000004},"min":{"1min":0.40999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.5009999999999999},"last":0.94699999999999995}]},{"osd":2,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.69199999999999995,"15min":0.749},"min":{"1min":0.38900000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0880000000000001,"5min":1.115,"15min":1.3700000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.36299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1579999999999999,"5min":1.655,"15min":5.452},"last":0.749}]},{"osd":3,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.79700000000000004,"15min":0.82899999999999996},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":3.1240000000000001,"15min":4.9249999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.82799999999999996,"15min":0.90000000000000002},"min":{"1min":0.44800000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.244,"5min":1.244,"15min":2.5859999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.71599999999999997,"15min":0.76100000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.296,"5min":1.726,"15min":1.726},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.80100000000000005,"15min":0.83099999999999996},"min":{"1min":0.34200000000000003,"5min":0.307,"15min":0.28799999999999998},"max":{"1min":2.085,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.78000000000000003,"15min":0.89100000000000001},"min":{"1min":0.47699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":4.1150000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.153,"5min":0.89700000000000002,"15min":0.95299999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.968,"5min":1.968,"15min":4.2350000000000003},"last":0.88400000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:25:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.92300000000000004,"15min":0.94299999999999995},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.39800000000000002},"max":{"1min":1.444,"5min":3.024,"15min":4.1840000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.86799999999999999,"15min":0.94899999999999995},"min":{"1min":0.58799999999999997,"5min":0.36799999999999999,"15min":0.34499999999999997},"max":{"1min":1.476,"5min":3.1709999999999998,"15min":5.431},"last":1.0149999999999999}]}]},{"osd":6,"up_from":16,"seq":68719476952,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367552,"kb_used_data":79736,"kb_used_omap":1,"kb_used_meta":287806,"kb_avail":94004288,"statfs":{"total":96636764160,"available":96260390912,"internally_reserved":0,"allocated":81649664,"data_stored":81283602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":294713800},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.84099999999999997,"15min":0.77600000000000002},"min":{"1min":0.55800000000000005,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.212,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.94699999999999995,"15min":0.85099999999999998},"min":{"1min":0.61699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.155,"5min":10.127000000000001,"15min":10.127000000000001},"last":1.04}]},{"osd":1,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.95699999999999996,"15min":0.82399999999999995},"min":{"1min":0.60399999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0720000000000001,"5min":12.565,"15min":12.565},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.117,"15min":0.89100000000000001},"min":{"1min":0.66300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.1899999999999999,"5min":16.579999999999998,"15min":16.579999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.76800000000000002},"min":{"1min":0.623,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.2929999999999999,"5min":6.202,"15min":6.202},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.91500000000000004,"15min":0.875},"min":{"1min":0.622,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.198,"5min":9.2219999999999995,"15min":9.2219999999999995},"last":1.0640000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.996,"15min":0.90400000000000003},"min":{"1min":0.66300000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1559999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.84199999999999997,"15min":0.84099999999999997},"min":{"1min":0.68899999999999995,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2290000000000001,"5min":7.7679999999999998,"15min":7.7679999999999998},"last":0.76600000000000001}]},{"osd":4,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.85299999999999998,"15min":0.83299999999999996},"min":{"1min":0.624,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.329,"5min":9.1929999999999996,"15min":9.1929999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.91200000000000003,"15min":0.88400000000000001},"min":{"1min":0.66600000000000004,"5min":0.25,"15min":0.25},"max":{"1min":1.2470000000000001,"5min":10.08,"15min":10.08},"last":0.91000000000000003}]},{"osd":5,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.84499999999999997,"15min":0.95199999999999996},"min":{"1min":0.55300000000000005,"5min":0.254,"15min":0.254},"max":{"1min":1.206,"5min":3.3149999999999999,"15min":27.231000000000002},"last":0.88},{"interface":"front","average":{"1min":1.042,"5min":1.0760000000000001,"15min":1.115},"min":{"1min":0.67800000000000005,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.2849999999999999,"5min":9.2509999999999994,"15min":27.478999999999999},"last":1.2170000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.028,"15min":1.0009999999999999},"min":{"1min":0.77400000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4330000000000001,"5min":10.182,"15min":10.182},"last":0.998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.875,"15min":0.95299999999999996},"min":{"1min":0.86199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.425,"5min":1.6839999999999999,"15min":2.7440000000000002},"last":0.93999999999999995}]}]},{"osd":5,"up_from":16,"seq":68719476952,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514432,"kb_used_data":104312,"kb_used_omap":1,"kb_used_meta":410110,"kb_avail":93857408,"statfs":{"total":96636764160,"available":96109985792,"internally_reserved":0,"allocated":106815488,"data_stored":106436602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":419953095},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.66000000000000003,"5min":0.246,"15min":0.246},"max":{"1min":1.1439999999999999,"5min":2.073,"15min":3.6739999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.91600000000000004,"15min":0.81399999999999995},"min":{"1min":0.58499999999999996,"5min":0.255,"15min":0.255},"max":{"1min":1.1890000000000001,"5min":20.013000000000002,"15min":20.013000000000002},"last":1.0009999999999999}]},{"osd":1,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.624,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.177,"5min":7.2469999999999999,"15min":7.2469999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.88400000000000001,"15min":0.84199999999999997},"min":{"1min":0.66000000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.302,"5min":10.231,"15min":10.231},"last":1.04}]},{"osd":2,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91300000000000003,"15min":0.84599999999999997},"min":{"1min":0.70399999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2989999999999999,"5min":12.041,"15min":12.041},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.67500000000000004,"5min":0.317,"15min":0.317},"max":{"1min":1.256,"5min":3.581,"15min":3.581},"last":1.0780000000000001}]},{"osd":3,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":0.93500000000000005},"min":{"1min":0.80400000000000005,"5min":0.378,"15min":0.378},"max":{"1min":1.353,"5min":16.183,"15min":16.183},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.075,"5min":0.93200000000000005,"15min":0.98099999999999998},"min":{"1min":0.69299999999999995,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.5129999999999999,"5min":4.0990000000000002,"15min":13.678000000000001},"last":1.1180000000000001}]},{"osd":4,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.60399999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.169,"5min":3.548,"15min":3.548},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.88500000000000001,"15min":0.90800000000000003},"min":{"1min":0.61199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.444,"5min":2.2080000000000002,"15min":2.2200000000000002},"last":1.1830000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.92600000000000005,"15min":0.93600000000000005},"min":{"1min":0.70299999999999996,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.593,"5min":3.532,"15min":3.532},"last":1.21},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.78400000000000003,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":1.48,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":1.155}]},{"osd":7,"last update":"Mon Mar 18 18:26:33 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.1259999999999999,"15min":1.0629999999999999},"min":{"1min":0.77200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5449999999999999,"5min":12.766,"15min":12.766},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.133,"15min":1.091},"min":{"1min":0.99099999999999999,"5min":0.373,"15min":0.373},"max":{"1min":1.649,"5min":12.788,"15min":12.788},"last":1.3120000000000001}]}]},{"osd":4,"up_from":16,"seq":68719476950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405736,"kb_used_data":53920,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93966104,"statfs":{"total":96636764160,"available":96221290496,"internally_reserved":0,"allocated":55214080,"data_stored":54845832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":360249799},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.75800000000000001,"15min":0.72999999999999998},"min":{"1min":0.54400000000000004,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.125,"5min":2.536,"15min":2.536},"last":1.04},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.67000000000000004,"15min":0.70399999999999996},"min":{"1min":0.54500000000000004,"5min":0.251,"15min":0.251},"max":{"1min":1.0049999999999999,"5min":1.2130000000000001,"15min":1.946},"last":1.012}]},{"osd":1,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80200000000000005,"15min":0.76400000000000001},"min":{"1min":0.59899999999999998,"5min":0.254,"15min":0.254},"max":{"1min":1.212,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93899999999999995,"15min":0.86299999999999999},"min":{"1min":0.61799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.21,"5min":17.451000000000001,"15min":17.451000000000001},"last":1.179}]},{"osd":2,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.85299999999999998,"15min":0.83099999999999996},"min":{"1min":0.65900000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.157,"5min":4.3979999999999997,"15min":5.6580000000000004},"last":1.274},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.84399999999999997,"15min":0.85599999999999998},"min":{"1min":0.69099999999999995,"5min":0.31,"15min":0.31},"max":{"1min":1.1699999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.91600000000000004}]},{"osd":3,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.79500000000000004,"15min":0.81999999999999995},"min":{"1min":0.69299999999999995,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.0820000000000001,"5min":2.681,"15min":2.681},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.67300000000000004,"5min":0.42499999999999999,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":1.228}]},{"osd":5,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.79500000000000004,"15min":0.84899999999999998},"min":{"1min":0.56000000000000005,"5min":0.307,"15min":0.251},"max":{"1min":1.1679999999999999,"5min":2.613,"15min":4.7119999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81399999999999995,"15min":0.88},"min":{"1min":0.54100000000000004,"5min":0.31,"15min":0.31},"max":{"1min":1.1899999999999999,"5min":1.393,"15min":4.7480000000000002},"last":1.0860000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.63900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.135,"5min":4.5620000000000003,"15min":4.9669999999999996},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.91100000000000003,"15min":0.95999999999999996},"min":{"1min":0.52200000000000002,"5min":0.38600000000000001,"15min":0.33000000000000002},"max":{"1min":1.252,"5min":2.6400000000000001,"15min":2.6619999999999999},"last":1.119}]},{"osd":7,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.86499999999999999,"15min":0.93700000000000006},"min":{"1min":0.48199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.145,"5min":1.4359999999999999,"15min":3.96},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.01,"15min":1.028},"min":{"1min":0.58999999999999997,"5min":0.42899999999999999,"15min":0.40999999999999998},"max":{"1min":1.29,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.319}]}]},{"osd":2,"up_from":15,"seq":64424509655,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":260836,"kb_used_data":45212,"kb_used_omap":1,"kb_used_meta":215614,"kb_avail":94111004,"statfs":{"total":96636764160,"available":96369668096,"internally_reserved":0,"allocated":46297088,"data_stored":45936802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220789190},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.46000000000000002,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":0.89900000000000002,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.443,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.96199999999999997,"5min":2.7309999999999999,"15min":2.7309999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.70499999999999996},"min":{"1min":0.54400000000000004,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94399999999999995,"5min":1.117,"15min":1.3149999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78100000000000003,"15min":0.78500000000000003},"min":{"1min":0.47999999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0589999999999999,"5min":1.1060000000000001,"15min":1.3},"last":0.747}]},{"osd":3,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.84399999999999997,"15min":0.78600000000000003},"min":{"1min":0.52900000000000003,"5min":0.254,"15min":0.254},"max":{"1min":1.079,"5min":12.778,"15min":12.778},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.95499999999999996,"15min":0.84099999999999997},"min":{"1min":0.51300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.1060000000000001,"5min":12.84,"15min":12.84},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.873,"15min":0.86499999999999999},"min":{"1min":0.74399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0109999999999999,"15min":0.97299999999999998},"min":{"1min":0.72799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.5369999999999999,"5min":6.9729999999999999,"15min":6.9729999999999999},"last":0.81499999999999995}]},{"osd":5,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.1040000000000001,"15min":1.024},"min":{"1min":0.79900000000000004,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.587,"5min":12.807,"15min":12.807},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.4339999999999999,"15min":1.1359999999999999},"min":{"1min":0.81799999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.403,"5min":24.102,"15min":24.102},"last":0.85199999999999998}]},{"osd":6,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.034,"15min":1.0589999999999999},"min":{"1min":0.79000000000000004,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.393,"5min":1.4079999999999999,"15min":2.4260000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.048,"15min":1.0529999999999999},"min":{"1min":0.83399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5009999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.079}]},{"osd":7,"last update":"Mon Mar 18 18:26:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.95199999999999996,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":2.2690000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.0620000000000001,"15min":1.087},"min":{"1min":0.92700000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4790000000000001,"5min":1.518,"15min":1.8320000000000001},"last":1.052}]}]},{"osd":1,"up_from":15,"seq":64424509655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410668,"kb_used_data":90788,"kb_used_omap":1,"kb_used_meta":319870,"kb_avail":93961172,"statfs":{"total":96636764160,"available":96216240128,"internally_reserved":0,"allocated":92966912,"data_stored":92594645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":327547334},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57299999999999995,"15min":0.58599999999999997},"min":{"1min":0.435,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.86499999999999999,"5min":0.88600000000000001,"15min":1.1359999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79900000000000004,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":1.105,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.0409999999999999}]},{"osd":2,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.73799999999999999},"min":{"1min":0.57199999999999995,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.97399999999999998,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.47099999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.995,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":0.80300000000000005}]},{"osd":3,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.40300000000000002,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":1.1919999999999999,"5min":2.8170000000000002,"15min":4.069},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.79800000000000004},"min":{"1min":0.54400000000000004,"5min":0.32700000000000001,"15min":0.27100000000000002},"max":{"1min":1.194,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":0.91200000000000003}]},{"osd":4,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.89300000000000002,"15min":0.86499999999999999},"min":{"1min":0.60899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0589999999999999,"5min":5.8360000000000003,"15min":5.8360000000000003},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97399999999999998},"min":{"1min":0.79900000000000004,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.212,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.91600000000000004,"15min":0.92400000000000004},"min":{"1min":0.66000000000000003,"5min":0.32100000000000001,"15min":0.317},"max":{"1min":1.5860000000000001,"5min":4.1200000000000001,"15min":4.1200000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.92900000000000005,"15min":0.95199999999999996},"min":{"1min":0.71599999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.2230000000000001,"5min":2.2069999999999999,"15min":3.6230000000000002},"last":1.1160000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0880000000000001,"15min":1.0800000000000001},"min":{"1min":0.90200000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3839999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":0.998,"15min":1.0149999999999999},"min":{"1min":0.79500000000000004,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.484,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":1.0860000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:26:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.127,"15min":1.1319999999999999},"min":{"1min":0.95799999999999996,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3380000000000001,"5min":2.6709999999999998,"15min":2.774},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.72999999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.631,"5min":4.1509999999999998,"15min":4.798},"last":1.2210000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542359,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319168,"kb_used_data":49336,"kb_used_omap":1,"kb_used_meta":269822,"kb_avail":94052672,"statfs":{"total":96636764160,"available":96309936128,"internally_reserved":0,"allocated":50520064,"data_stored":50148196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":276298185},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.59399999999999997},"min":{"1min":0.48499999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.89300000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80800000000000005,"15min":0.72299999999999998},"min":{"1min":0.505,"5min":0.222,"15min":0.222},"max":{"1min":1.2010000000000001,"5min":11.132,"15min":11.132},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.58299999999999996,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.92100000000000004,"5min":1.857,"15min":3.3839999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69099999999999995,"15min":0.70299999999999996},"min":{"1min":0.45200000000000001,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":1.052,"5min":2.5209999999999999,"15min":3.4260000000000002},"last":0.53100000000000003}]},{"osd":2,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.86199999999999999,"15min":0.78600000000000003},"min":{"1min":0.47799999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.97099999999999997,"5min":12.564,"15min":12.564},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.93100000000000005,"15min":0.84799999999999998},"min":{"1min":0.433,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":1.0209999999999999,"5min":12.657,"15min":12.657},"last":0.754}]},{"osd":4,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.88200000000000001,"15min":0.875},"min":{"1min":0.69399999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1539999999999999,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97099999999999997,"15min":0.94699999999999995},"min":{"1min":0.76500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.296,"5min":2.609,"15min":2.609},"last":0.84699999999999998}]},{"osd":5,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92200000000000004,"15min":0.92900000000000005},"min":{"1min":0.69299999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.363,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.022,"15min":1.0049999999999999},"min":{"1min":0.72299999999999998,"5min":0.45200000000000001,"15min":0.40200000000000002},"max":{"1min":1.21,"5min":3.0419999999999998,"15min":3.0419999999999998},"last":1.1000000000000001}]},{"osd":6,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.034,"15min":1.0369999999999999},"min":{"1min":0.88600000000000001,"5min":0.41299999999999998,"15min":0.39700000000000002},"max":{"1min":1.3779999999999999,"5min":1.9179999999999999,"15min":3.3769999999999998},"last":1.141},{"interface":"front","average":{"1min":1.079,"5min":0.99099999999999999,"15min":0.998},"min":{"1min":0.74099999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":1.4199999999999999,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Mon Mar 18 18:26:30 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.155,"15min":1.0900000000000001},"min":{"1min":0.89700000000000002,"5min":0.47599999999999998,"15min":0.45300000000000001},"max":{"1min":1.3300000000000001,"5min":13.02,"15min":13.02},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.163,"5min":1.0820000000000001,"15min":1.079},"min":{"1min":0.76200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.448,"5min":1.893,"15min":1.9139999999999999},"last":1.0389999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542358,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263664,"kb_used_data":34024,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94108176,"statfs":{"total":96636764160,"available":96366772224,"internally_reserved":0,"allocated":34840576,"data_stored":34469140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":235141574},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.66900000000000004,"15min":0.622},"min":{"1min":0.39100000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71899999999999997,"5min":5.0229999999999997,"15min":5.0229999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.74399999999999999,"15min":0.71399999999999997},"min":{"1min":0.41899999999999998,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.84599999999999997,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.622}]},{"osd":2,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.92500000000000004,"5min":2.048,"15min":2.048},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.77200000000000002},"min":{"1min":0.441,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.997,"5min":3.4940000000000002,"15min":4.2750000000000004},"last":0.93000000000000005}]},{"osd":3,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.81200000000000006,"15min":0.77800000000000002},"min":{"1min":0.47099999999999997,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.95999999999999996,"5min":6.5430000000000001,"15min":6.5430000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.92000000000000004,"15min":0.86699999999999999},"min":{"1min":0.66200000000000003,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.032,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.88600000000000001}]},{"osd":4,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.879,"15min":0.89700000000000002},"min":{"1min":0.69899999999999995,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.266,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93300000000000005,"15min":0.93999999999999995},"min":{"1min":0.60999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.167,"5min":4.7169999999999996,"15min":4.7169999999999996},"last":1.0109999999999999}]},{"osd":5,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.1000000000000001,"15min":1.0289999999999999},"min":{"1min":0.872,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.353,"5min":14.869,"15min":14.869},"last":1.04},{"interface":"front","average":{"1min":1.089,"5min":1.1020000000000001,"15min":1.0329999999999999},"min":{"1min":0.84899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4199999999999999,"5min":14.804,"15min":14.804},"last":1.2609999999999999}]},{"osd":6,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.155,"15min":1.0800000000000001},"min":{"1min":0.83799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.446,"5min":9.4049999999999994,"15min":9.4049999999999994},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.83999999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.351,"5min":2.113,"15min":2.113},"last":1.1850000000000001}]},{"osd":7,"last update":"Mon Mar 18 18:26:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.113,"15min":1.081},"min":{"1min":0.88100000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.288,"5min":11.455,"15min":11.455},"last":1.288},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.2969999999999999,"15min":1.1759999999999999},"min":{"1min":0.94299999999999995,"5min":0.436,"15min":0.436},"max":{"1min":1.2709999999999999,"5min":13.829000000000001,"15min":13.829000000000001},"last":1.2090000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":33555070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92282880,"data_stored":92274993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45633536,"data_stored":45629481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49836032,"data_stored":49824457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106119168,"data_stored":106112848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":80957440,"data_stored":80947606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":32799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":28749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":16418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":32836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":28706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":32851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":45093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":36924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T18:26:42.584 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-18T18:26:42.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 Processor -- start 2024-03-18T18:26:42.701 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 -- start start 2024-03-18T18:26:42.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c06a3c0 0x7f9e3c146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e3c09dd40 0x7f9e3c0b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c0b8590 con 0x7f9e3c0b6c80 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b7620 con 0x7f9e3c09dd40 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e40c43700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1472c0 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e3c09dd40 0x7f9e3c0b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9e3c09dd40 0x7f9e3c0b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54684/0 (socket says 172.21.15.94:54684) 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 -- 172.21.15.94:0/3297294746 learned_addr learned my addr 172.21.15.94:0/3297294746 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3b7fe700 1 --2- 172.21.15.94:0/3297294746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c06a3c0 0x7f9e3c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 -- 172.21.15.94:0/3297294746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c06a3c0 msgr2=0x7f9e3c146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:42.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3a7fc700 1 -- 172.21.15.94:0/3297294746 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186663291 0 0) 0x7f9e3c0b8590 con 0x7f9e3c0b6c80 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 --2- 172.21.15.94:0/3297294746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c06a3c0 0x7f9e3c146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 -- 172.21.15.94:0/3297294746 >> v1:172.21.15.94:6789/0 conn(0x7f9e3c0b6c80 legacy=0x7f9e3c09d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 -- 172.21.15.94:0/3297294746 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c09bb60 con 0x7f9e3c09dd40 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3bfff700 1 --2- 172.21.15.94:0/3297294746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c0b70e0 secure :-1 s=READY pgs=4536 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009e50 tx=0x7f9e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7278c83ce594548 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3a7fc700 1 -- 172.21.15.94:0/3297294746 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400e070 con 0x7f9e3c09dd40 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3a7fc700 1 -- 172.21.15.94:0/3297294746 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400b910 con 0x7f9e3c09dd40 2024-03-18T18:26:42.705 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.698+0000 7f9e3a7fc700 1 -- 172.21.15.94:0/3297294746 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400bcc0 con 0x7f9e3c09dd40 2024-03-18T18:26:42.706 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 -- 172.21.15.94:0/3297294746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c09dd40 msgr2=0x7f9e3c0b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 --2- 172.21.15.94:0/3297294746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c0b70e0 secure :-1 s=READY pgs=4536 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009e50 tx=0x7f9e3400b330 comp rx=0 tx=0).stop 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 -- 172.21.15.94:0/3297294746 shutdown_connections 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 --2- 172.21.15.94:0/3297294746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c0b70e0 unknown :-1 s=CLOSED pgs=4536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 --2- 172.21.15.94:0/3297294746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c06a3c0 0x7f9e3c146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 -- 172.21.15.94:0/3297294746 >> 172.21.15.94:0/3297294746 conn(0x7f9e3c0bbda0 msgr2=0x7f9e3c0bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 -- 172.21.15.94:0/3297294746 shutdown_connections 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 -- 172.21.15.94:0/3297294746 wait complete. 2024-03-18T18:26:42.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 Processor -- start 2024-03-18T18:26:42.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 -- start start 2024-03-18T18:26:42.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 0x7f9e3c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c1df140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.702+0000 7f9e40c43700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c0b6c80 0x7f9e3c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e40c43700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b1a70 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e40c43700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c146690 con 0x7f9e3c09dd40 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 0x7f9e3c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 0x7f9e3c0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54690/0 (socket says 172.21.15.94:54690) 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e40c43700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0af490 con 0x7f9e3c0b6c80 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 -- 172.21.15.94:0/1265384155 learned_addr learned my addr 172.21.15.94:0/1265384155 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3bfff700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c0b6c80 0x7f9e3c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3affd700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c1df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.711 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 -- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c0b6c80 msgr2=0x7f9e3c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c0b6c80 0x7f9e3c0afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 -- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e3c09dd40 msgr2=0x7f9e3c1df140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c1df140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 -- 172.21.15.94:0/1265384155 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e34009b30 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3bfff700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c0b6c80 0x7f9e3c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3affd700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c1df140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e3b7fe700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 0x7f9e3c0b11e0 secure :-1 s=READY pgs=4537 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000e9d0 tx=0x7f9e3000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:42.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30009720 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000c850 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0b0800 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000cbc0 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c0b1720 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c146c30 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.706+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9e3000cd20 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.710+0000 7f9e23fff700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9e28066730 0x7f9e28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:42.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.710+0000 7f9e3affd700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9e28066730 0x7f9e28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:42.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.710+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9e30084260 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.710+0000 7f9e3affd700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9e28066730 0x7f9e28068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c09c3d0 tx=0x7f9e2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:42.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.714+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9e300515d0 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.886+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9e3c06aff0 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.898+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9e300515d0 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.898+0000 7f9e23fff700 1 -- 172.21.15.94:0/1265384155 <== mon.0 v2:172.21.15.94:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9e30054bf0 con 0x7f9e3c06a3c0 2024-03-18T18:26:42.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9e28066730 msgr2=0x7f9e28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9e28066730 0x7f9e28068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c09c3d0 tx=0x7f9e2c009040 comp rx=0 tx=0).stop 2024-03-18T18:26:42.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 msgr2=0x7f9e3c0b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:42.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 0x7f9e3c0b11e0 secure :-1 s=READY pgs=4537 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000e9d0 tx=0x7f9e3000ed90 comp rx=0 tx=0).stop 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 shutdown_connections 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f9e28066730 0x7f9e28068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e3c0b6c80 0x7f9e3c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e3c09dd40 0x7f9e3c1df140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 --2- 172.21.15.94:0/1265384155 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9e3c06a3c0 0x7f9e3c0b11e0 secure :-1 s=CLOSED pgs=4537 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000e9d0 tx=0x7f9e3000ed90 comp rx=0 tx=0).stop 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 >> 172.21.15.94:0/1265384155 conn(0x7f9e3c0bbda0 msgr2=0x7f9e3c0bb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 shutdown_connections 2024-03-18T18:26:42.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:42.902+0000 7f9e40c43700 1 -- 172.21.15.94:0/1265384155 wait complete. 2024-03-18T18:26:42.921 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T18:26:42.921 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:26:43.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 Processor -- start 2024-03-18T18:26:43.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- start start 2024-03-18T18:26:43.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde98140b00 0x7fde980b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde98150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980b9be0 con 0x7fde9809ac60 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980ba110 con 0x7fde98140b00 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9809b040 con 0x7fde980b8270 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde967fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde98140b00 0x7fde980b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde96ffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fde9809ac60 0x7fde981403f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42300/0 (socket says 172.21.15.94:42300) 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde96ffd700 1 -- 172.21.15.94:0/3737067 learned_addr learned my addr 172.21.15.94:0/3737067 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde977fe700 1 --2- 172.21.15.94:0/3737067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde98150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde967fc700 1 -- 172.21.15.94:0/3737067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 msgr2=0x7fde98150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde967fc700 1 --2- 172.21.15.94:0/3737067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde98150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde967fc700 1 -- 172.21.15.94:0/3737067 >> v1:172.21.15.94:6789/0 conn(0x7fde9809ac60 legacy=0x7fde981403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde967fc700 1 -- 172.21.15.94:0/3737067 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980b9e30 con 0x7fde98140b00 2024-03-18T18:26:43.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde967fc700 1 --2- 172.21.15.94:0/3737067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b87c0 secure :-1 s=READY pgs=4539 cs=0 l=1 rev1=1 crypto rx=0x7fde88009850 tx=0x7fde88009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876c637e9c40d485 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde95ffb700 1 -- 172.21.15.94:0/3737067 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88011830 con 0x7fde98140b00 2024-03-18T18:26:43.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde95ffb700 1 -- 172.21.15.94:0/3737067 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde88011990 con 0x7fde98140b00 2024-03-18T18:26:43.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde95ffb700 1 -- 172.21.15.94:0/3737067 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88011d60 con 0x7fde98140b00 2024-03-18T18:26:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- 172.21.15.94:0/3737067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 msgr2=0x7fde980b87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 --2- 172.21.15.94:0/3737067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b87c0 secure :-1 s=READY pgs=4539 cs=0 l=1 rev1=1 crypto rx=0x7fde88009850 tx=0x7fde88009b60 comp rx=0 tx=0).stop 2024-03-18T18:26:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- 172.21.15.94:0/3737067 shutdown_connections 2024-03-18T18:26:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 --2- 172.21.15.94:0/3737067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde98150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 --2- 172.21.15.94:0/3737067 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b87c0 unknown :-1 s=CLOSED pgs=4539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- 172.21.15.94:0/3737067 >> 172.21.15.94:0/3737067 conn(0x7fde9809dbf0 msgr2=0x7fde9809dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- 172.21.15.94:0/3737067 shutdown_connections 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.026+0000 7fde97fff700 1 -- 172.21.15.94:0/3737067 wait complete. 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 Processor -- start 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 -- start start 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde9809ac60 0x7fde9813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde980b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980b6030 con 0x7fde98140b00 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9809d220 con 0x7fde9809ac60 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980b4ea0 con 0x7fde980b8270 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54716/0 (socket says 172.21.15.94:54716) 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 -- 172.21.15.94:0/1709568165 learned_addr learned my addr 172.21.15.94:0/1709568165 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde967fc700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde980b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde96ffd700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde9809ac60 0x7fde9813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 -- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 msgr2=0x7fde980b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde980b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 -- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde9809ac60 msgr2=0x7fde9813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde9809ac60 0x7fde9813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 -- 172.21.15.94:0/1709568165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880094b0 con 0x7fde98140b00 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde977fe700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b5af0 secure :-1 s=READY pgs=4540 cs=0 l=1 rev1=1 crypto rx=0x7fde9000efc0 tx=0x7fde9000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9000cad0 con 0x7fde98140b00 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fde9000f040 con 0x7fde98140b00 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980b5110 con 0x7fde98140b00 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9000ce90 con 0x7fde98140b00 2024-03-18T18:26:43.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.030+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9809d600 con 0x7fde98140b00 2024-03-18T18:26:43.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.034+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde98067620 con 0x7fde98140b00 2024-03-18T18:26:43.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.034+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fde90014480 con 0x7fde98140b00 2024-03-18T18:26:43.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.034+0000 7fde7ffff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde84066730 0x7fde84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.034+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fde90084cc0 con 0x7fde98140b00 2024-03-18T18:26:43.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.034+0000 7fde96ffd700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde84066730 0x7fde84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.034+0000 7fde96ffd700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde84066730 0x7fde84068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde8c005930 tx=0x7fde8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.042+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fde9008b080 con 0x7fde98140b00 2024-03-18T18:26:43.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.250+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde98074440 con 0x7fde98140b00 2024-03-18T18:26:43.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde7ffff700 1 -- 172.21.15.94:0/1709568165 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3210 (secure 0 0 0) 0x7fde90018090 con 0x7fde98140b00 2024-03-18T18:26:43.256 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:26:43.257 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T18:09:12.802236+0000","modified":"2024-03-18T18:09:14.818548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-18T18:26:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde84066730 msgr2=0x7fde84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde84066730 0x7fde84068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde8c005930 tx=0x7fde8c009040 comp rx=0 tx=0).stop 2024-03-18T18:26:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 msgr2=0x7fde980b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b5af0 secure :-1 s=READY pgs=4540 cs=0 l=1 rev1=1 crypto rx=0x7fde9000efc0 tx=0x7fde9000c0c0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 shutdown_connections 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fde84066730 0x7fde84068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde98140b00 0x7fde980b5af0 unknown :-1 s=CLOSED pgs=4540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde980b8270 0x7fde980b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 --2- 172.21.15.94:0/1709568165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde9809ac60 0x7fde9813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 >> 172.21.15.94:0/1709568165 conn(0x7fde9809dbf0 msgr2=0x7fde98146c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 shutdown_connections 2024-03-18T18:26:43.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.254+0000 7fde97fff700 1 -- 172.21.15.94:0/1709568165 wait complete. 2024-03-18T18:26:43.261 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-03-18T18:26:43.272 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T18:26:43.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186ffff700 1 Processor -- start 2024-03-18T18:26:43.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186ffff700 1 -- start start 2024-03-18T18:26:43.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1870140b00 0x7f18700b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186ffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700b9be0 con 0x7f187009ac60 2024-03-18T18:26:43.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186ffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700ba110 con 0x7f18700b8270 2024-03-18T18:26:43.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187009b040 con 0x7f1870140b00 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186effd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f187009ac60 0x7f18701403f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42306/0 (socket says 172.21.15.94:42306) 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f186effd700 1 -- 172.21.15.94:0/1872737396 learned_addr learned my addr 172.21.15.94:0/1872737396 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.382+0000 7f1867fff700 1 --2- 172.21.15.94:0/1872737396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1870140b00 0x7f18700b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186e7fc700 1 -- 172.21.15.94:0/1872737396 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614458137 0 0) 0x7f18700b9be0 con 0x7f187009ac60 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186e7fc700 1 -- 172.21.15.94:0/1872737396 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185c0035d0 con 0x7f187009ac60 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f1867fff700 1 -- 172.21.15.94:0/1872737396 >> v1:172.21.15.151:6789/0 conn(0x7f18700b8270 legacy=0x7f1870150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f1867fff700 1 -- 172.21.15.94:0/1872737396 >> v1:172.21.15.94:6789/0 conn(0x7f187009ac60 legacy=0x7f18701403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f1867fff700 1 -- 172.21.15.94:0/1872737396 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700b9e30 con 0x7f1870140b00 2024-03-18T18:26:43.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f1867fff700 1 --2- 172.21.15.94:0/1872737396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1870140b00 0x7f18700b87c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1858009880 tx=0x7f1858009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74c7ed989061779d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186e7fc700 1 -- 172.21.15.94:0/1872737396 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011830 con 0x7f1870140b00 2024-03-18T18:26:43.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186e7fc700 1 -- 172.21.15.94:0/1872737396 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1858011990 con 0x7f1870140b00 2024-03-18T18:26:43.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186e7fc700 1 -- 172.21.15.94:0/1872737396 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011d40 con 0x7f1870140b00 2024-03-18T18:26:43.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 -- 172.21.15.94:0/1872737396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1870140b00 msgr2=0x7f18700b87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 --2- 172.21.15.94:0/1872737396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1870140b00 0x7f18700b87c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1858009880 tx=0x7f1858009b90 comp rx=0 tx=0).stop 2024-03-18T18:26:43.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 -- 172.21.15.94:0/1872737396 shutdown_connections 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 --2- 172.21.15.94:0/1872737396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1870140b00 0x7f18700b87c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 -- 172.21.15.94:0/1872737396 >> 172.21.15.94:0/1872737396 conn(0x7f187009dbf0 msgr2=0x7f187009dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 -- 172.21.15.94:0/1872737396 shutdown_connections 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 -- 172.21.15.94:0/1872737396 wait complete. 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 Processor -- start 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.386+0000 7f186ffff700 1 -- start start 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 0x7f18700b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700b8270 0x7f18701dc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1870140b00 0x7f18701dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b5640 con 0x7f187009ac60 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b3460 con 0x7f1870140b00 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b3180 con 0x7f18700b8270 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 0x7f18700b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 0x7f18700b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54732/0 (socket says 172.21.15.94:54732) 2024-03-18T18:26:43.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 -- 172.21.15.94:0/1960208092 learned_addr learned my addr 172.21.15.94:0/1960208092 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f1867fff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700b8270 0x7f18701dc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186f7fe700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1870140b00 0x7f18701dcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 -- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700b8270 msgr2=0x7f18701dc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700b8270 0x7f18701dc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 -- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1870140b00 msgr2=0x7f18701dcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1870140b00 0x7f18701dcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 -- 172.21.15.94:0/1960208092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580094b0 con 0x7f187009ac60 2024-03-18T18:26:43.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186f7fe700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1870140b00 0x7f18701dcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:26:43.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186effd700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 0x7f18700b40d0 secure :-1 s=READY pgs=4542 cs=0 l=1 rev1=1 crypto rx=0x7f186000c700 tx=0x7f186000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860005d90 con 0x7f187009ac60 2024-03-18T18:26:43.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f18600070d0 con 0x7f187009ac60 2024-03-18T18:26:43.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18700b5840 con 0x7f187009ac60 2024-03-18T18:26:43.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18600074a0 con 0x7f187009ac60 2024-03-18T18:26:43.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1870149a70 con 0x7f187009ac60 2024-03-18T18:26:43.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1860007600 con 0x7f187009ac60 2024-03-18T18:26:43.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.390+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870067620 con 0x7f187009ac60 2024-03-18T18:26:43.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.394+0000 7f18677fe700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1850066730 0x7f1850068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.394+0000 7f1867fff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1850066730 0x7f1850068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.394+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f18600836d0 con 0x7f187009ac60 2024-03-18T18:26:43.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.394+0000 7f1867fff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1850066730 0x7f1850068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18580090b0 tx=0x7f1858010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.402+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1860050a40 con 0x7f187009ac60 2024-03-18T18:26:43.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.610+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1870074440 con 0x7f187009ac60 2024-03-18T18:26:43.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.610+0000 7f18677fe700 1 -- 172.21.15.94:0/1960208092 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3210 (secure 0 0 0) 0x7f1860054060 con 0x7f187009ac60 2024-03-18T18:26:43.614 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:26:43.614 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/3344076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":3344076},{"type":"v1","addr":"172.21.15.94:6835","nonce":3344076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T18:09:12.802236+0000","modified":"2024-03-18T18:09:14.818548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1854308487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1854308487},{"type":"v1","addr":"172.21.15.151:6833","nonce":1854308487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-18T18:26:43.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1850066730 msgr2=0x7f1850068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1850066730 0x7f1850068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18580090b0 tx=0x7f1858010000 comp rx=0 tx=0).stop 2024-03-18T18:26:43.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 msgr2=0x7f18700b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 0x7f18700b40d0 secure :-1 s=READY pgs=4542 cs=0 l=1 rev1=1 crypto rx=0x7f186000c700 tx=0x7f186000ca10 comp rx=0 tx=0).stop 2024-03-18T18:26:43.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 shutdown_connections 2024-03-18T18:26:43.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1850066730 0x7f1850068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1870140b00 0x7f18701dcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700b8270 0x7f18701dc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 --2- 172.21.15.94:0/1960208092 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f187009ac60 0x7f18700b40d0 unknown :-1 s=CLOSED pgs=4542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 >> 172.21.15.94:0/1960208092 conn(0x7f187009dbf0 msgr2=0x7f18700bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:43.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 shutdown_connections 2024-03-18T18:26:43.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.614+0000 7f186ffff700 1 -- 172.21.15.94:0/1960208092 wait complete. 2024-03-18T18:26:43.619 INFO:teuthology.orchestra.run.smithi094.stderr:dumped fsmap epoch 6 2024-03-18T18:26:43.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T18:26:43.745 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 Processor -- start 2024-03-18T18:26:43.746 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 -- start start 2024-03-18T18:26:43.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3780b9df0 0x7fe37813e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe37813e840 0x7fe378144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe378144aa0 0x7fe3781479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.748 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37813ec80 con 0x7fe37813e840 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe378144f30 con 0x7fe378144aa0 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37d2f9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780b5ea0 con 0x7fe3780b9df0 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe37813e840 0x7fe378144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe37813e840 0x7fe378144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54736/0 (socket says 172.21.15.94:54736) 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 -- 172.21.15.94:0/3671108191 learned_addr learned my addr 172.21.15.94:0/3671108191 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe377fff700 1 --2- 172.21.15.94:0/3671108191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3780b9df0 0x7fe37813e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe37caf8700 1 --2- 172.21.15.94:0/3671108191 >> v2:172.21.15.151:3300/0 conn(0x7fe378144aa0 0x7fe3781479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.749 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 -- 172.21.15.94:0/3671108191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3780b9df0 msgr2=0x7fe37813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 --2- 172.21.15.94:0/3671108191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3780b9df0 0x7fe37813e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 -- 172.21.15.94:0/3671108191 >> v2:172.21.15.151:3300/0 conn(0x7fe378144aa0 msgr2=0x7fe3781479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 --2- 172.21.15.94:0/3671108191 >> v2:172.21.15.151:3300/0 conn(0x7fe378144aa0 0x7fe3781479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 -- 172.21.15.94:0/3671108191 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780ba1d0 con 0x7fe37813e840 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.742+0000 7fe3777fe700 1 --2- 172.21.15.94:0/3671108191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe37813e840 0x7fe378144560 secure :-1 s=READY pgs=4543 cs=0 l=1 rev1=1 crypto rx=0x7fe378144460 tx=0x7fe36c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2f1d3355902c00 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe376ffd700 1 -- 172.21.15.94:0/3671108191 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011830 con 0x7fe37813e840 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe376ffd700 1 -- 172.21.15.94:0/3671108191 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe36c011990 con 0x7fe37813e840 2024-03-18T18:26:43.750 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe376ffd700 1 -- 172.21.15.94:0/3671108191 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011d60 con 0x7fe37813e840 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 -- 172.21.15.94:0/3671108191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe37813e840 msgr2=0x7fe378144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/3671108191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe37813e840 0x7fe378144560 secure :-1 s=READY pgs=4543 cs=0 l=1 rev1=1 crypto rx=0x7fe378144460 tx=0x7fe36c009c20 comp rx=0 tx=0).stop 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 -- 172.21.15.94:0/3671108191 shutdown_connections 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/3671108191 >> v2:172.21.15.151:3300/0 conn(0x7fe378144aa0 0x7fe3781479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/3671108191 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe37813e840 0x7fe378144560 unknown :-1 s=CLOSED pgs=4543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/3671108191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3780b9df0 0x7fe37813e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 -- 172.21.15.94:0/3671108191 >> 172.21.15.94:0/3671108191 conn(0x7fe37806a150 msgr2=0x7fe37806a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:43.751 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 -- 172.21.15.94:0/3671108191 shutdown_connections 2024-03-18T18:26:43.752 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 -- 172.21.15.94:0/3671108191 wait complete. 2024-03-18T18:26:43.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 Processor -- start 2024-03-18T18:26:43.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.746+0000 7fe37d2f9700 1 -- start start 2024-03-18T18:26:43.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b9df0 0x7fe37813b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.754 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37813e840 0x7fe3780adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 0x7fe3781ded70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37813dd40 con 0x7fe378144aa0 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37813d110 con 0x7fe3780b9df0 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780af230 con 0x7fe37813e840 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 0x7fe3781ded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe3777fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37813e840 0x7fe3780adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe377fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b9df0 0x7fe37813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 0x7fe3781ded70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54738/0 (socket says 172.21.15.94:54738) 2024-03-18T18:26:43.755 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 -- 172.21.15.94:0/443594143 learned_addr learned my addr 172.21.15.94:0/443594143 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 -- 172.21.15.94:0/443594143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37813e840 msgr2=0x7fe3780adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37813e840 0x7fe3780adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 -- 172.21.15.94:0/443594143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b9df0 msgr2=0x7fe37813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b9df0 0x7fe37813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 -- 172.21.15.94:0/443594143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009570 con 0x7fe378144aa0 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37caf8700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 0x7fe3781ded70 secure :-1 s=READY pgs=4544 cs=0 l=1 rev1=1 crypto rx=0x7fe37000efc0 tx=0x7fe37000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000cad0 con 0x7fe378144aa0 2024-03-18T18:26:43.756 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe37000f040 con 0x7fe378144aa0 2024-03-18T18:26:43.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3780ae420 con 0x7fe378144aa0 2024-03-18T18:26:43.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000ce90 con 0x7fe378144aa0 2024-03-18T18:26:43.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3780ad370 con 0x7fe378144aa0 2024-03-18T18:26:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.750+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3780acd00 con 0x7fe378144aa0 2024-03-18T18:26:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.754+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe370014480 con 0x7fe378144aa0 2024-03-18T18:26:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.754+0000 7fe374ff9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe364066730 0x7fe364068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.754+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe370084940 con 0x7fe378144aa0 2024-03-18T18:26:43.758 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.754+0000 7fe377fff700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe364066730 0x7fe364068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:43.759 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.754+0000 7fe377fff700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe364066730 0x7fe364068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe368009b70 tx=0x7fe368009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:43.764 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.762+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe370051c20 con 0x7fe378144aa0 2024-03-18T18:26:43.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.934+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe378074440 con 0x7fe378144aa0 2024-03-18T18:26:43.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.938+0000 7fe374ff9700 1 -- 172.21.15.94:0/443594143 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16352 (secure 0 0 0) 0x7fe370018090 con 0x7fe378144aa0 2024-03-18T18:26:43.942 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-18T18:26:43.942 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":56,"fsid":"9be12cb7-8488-4090-a5db-a2b29f4bc5c3","created":"2024-03-18T18:08:47.366089+0000","modified":"2024-03-18T18:25:37.740294+0000","last_up_change":"2024-03-18T18:08:59.860665+0000","last_in_change":"2024-03-18T18:08:50.351061+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T18:08:58.619045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T18:09:10.506373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T18:09:11.785352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c6d875d-363b-48ff-855e-ea3310bb4b9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":26022},{"type":"v1","addr":"172.21.15.94:6801","nonce":26022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":26022},{"type":"v1","addr":"172.21.15.94:6803","nonce":26022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":26022},{"type":"v1","addr":"172.21.15.94:6807","nonce":26022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":26022},{"type":"v1","addr":"172.21.15.94:6805","nonce":26022}]},"public_addr":"172.21.15.94:6801/26022","cluster_addr":"172.21.15.94:6803/26022","heartbeat_back_addr":"172.21.15.94:6807/26022","heartbeat_front_addr":"172.21.15.94:6805/26022","state":["exists","up"]},{"osd":1,"uuid":"e5f2517d-ba21-455c-8407-754f0bb11499","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":26023},{"type":"v1","addr":"172.21.15.94:6810","nonce":26023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":26023},{"type":"v1","addr":"172.21.15.94:6814","nonce":26023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":26023},{"type":"v1","addr":"172.21.15.94:6822","nonce":26023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":26023},{"type":"v1","addr":"172.21.15.94:6818","nonce":26023}]},"public_addr":"172.21.15.94:6810/26023","cluster_addr":"172.21.15.94:6814/26023","heartbeat_back_addr":"172.21.15.94:6822/26023","heartbeat_front_addr":"172.21.15.94:6818/26023","state":["exists","up"]},{"osd":2,"uuid":"e2df52ba-c9a5-4aca-b560-47db406b5a72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":26033},{"type":"v1","addr":"172.21.15.94:6825","nonce":26033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":26033},{"type":"v1","addr":"172.21.15.94:6827","nonce":26033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":26033},{"type":"v1","addr":"172.21.15.94:6831","nonce":26033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":26033},{"type":"v1","addr":"172.21.15.94:6829","nonce":26033}]},"public_addr":"172.21.15.94:6825/26033","cluster_addr":"172.21.15.94:6827/26033","heartbeat_back_addr":"172.21.15.94:6831/26033","heartbeat_front_addr":"172.21.15.94:6829/26033","state":["exists","up"]},{"osd":3,"uuid":"56440f46-def3-45e5-b91c-412d16724605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6809","nonce":26024},{"type":"v1","addr":"172.21.15.94:6811","nonce":26024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6813","nonce":26024},{"type":"v1","addr":"172.21.15.94:6815","nonce":26024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":26024},{"type":"v1","addr":"172.21.15.94:6823","nonce":26024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6817","nonce":26024},{"type":"v1","addr":"172.21.15.94:6819","nonce":26024}]},"public_addr":"172.21.15.94:6811/26024","cluster_addr":"172.21.15.94:6815/26024","heartbeat_back_addr":"172.21.15.94:6823/26024","heartbeat_front_addr":"172.21.15.94:6819/26024","state":["exists","up"]},{"osd":4,"uuid":"de0d55b5-88f7-4ebf-802f-3ed4f66bd7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":26215},{"type":"v1","addr":"172.21.15.151:6823","nonce":26215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":26215},{"type":"v1","addr":"172.21.15.151:6826","nonce":26215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":26215},{"type":"v1","addr":"172.21.15.151:6831","nonce":26215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":26215},{"type":"v1","addr":"172.21.15.151:6829","nonce":26215}]},"public_addr":"172.21.15.151:6823/26215","cluster_addr":"172.21.15.151:6826/26215","heartbeat_back_addr":"172.21.15.151:6831/26215","heartbeat_front_addr":"172.21.15.151:6829/26215","state":["exists","up"]},{"osd":5,"uuid":"383029a0-1add-4835-b84c-d3a3294bea0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":26217},{"type":"v1","addr":"172.21.15.151:6809","nonce":26217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":26217},{"type":"v1","addr":"172.21.15.151:6811","nonce":26217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":26217},{"type":"v1","addr":"172.21.15.151:6815","nonce":26217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":26217},{"type":"v1","addr":"172.21.15.151:6813","nonce":26217}]},"public_addr":"172.21.15.151:6809/26217","cluster_addr":"172.21.15.151:6811/26217","heartbeat_back_addr":"172.21.15.151:6815/26217","heartbeat_front_addr":"172.21.15.151:6813/26217","state":["exists","up"]},{"osd":6,"uuid":"250ec149-fe27-4c12-910f-aa08e7d49008","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":26216},{"type":"v1","addr":"172.21.15.151:6817","nonce":26216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":26216},{"type":"v1","addr":"172.21.15.151:6819","nonce":26216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6825","nonce":26216},{"type":"v1","addr":"172.21.15.151:6828","nonce":26216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":26216},{"type":"v1","addr":"172.21.15.151:6821","nonce":26216}]},"public_addr":"172.21.15.151:6817/26216","cluster_addr":"172.21.15.151:6819/26216","heartbeat_back_addr":"172.21.15.151:6828/26216","heartbeat_front_addr":"172.21.15.151:6821/26216","state":["exists","up"]},{"osd":7,"uuid":"83b9ae4a-5c56-4c84-a38f-b7e1aceb5e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":26214},{"type":"v1","addr":"172.21.15.151:6801","nonce":26214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":26214},{"type":"v1","addr":"172.21.15.151:6803","nonce":26214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":26214},{"type":"v1","addr":"172.21.15.151:6807","nonce":26214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":26214},{"type":"v1","addr":"172.21.15.151:6805","nonce":26214}]},"public_addr":"172.21.15.151:6801/26214","cluster_addr":"172.21.15.151:6803/26214","heartbeat_back_addr":"172.21.15.151:6807/26214","heartbeat_front_addr":"172.21.15.151:6805/26214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.238151+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.643819+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.633408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.421742+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.693525+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.577862+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.925997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T18:08:55.841414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":64,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T18:26:43.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe364066730 msgr2=0x7fe364068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe364066730 0x7fe364068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe368009b70 tx=0x7fe368009240 comp rx=0 tx=0).stop 2024-03-18T18:26:43.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 msgr2=0x7fe3781ded70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:43.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 0x7fe3781ded70 secure :-1 s=READY pgs=4544 cs=0 l=1 rev1=1 crypto rx=0x7fe37000efc0 tx=0x7fe37000c0c0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 shutdown_connections 2024-03-18T18:26:43.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fe364066730 0x7fe364068bf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe378144aa0 0x7fe3781ded70 unknown :-1 s=CLOSED pgs=4544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe37813e840 0x7fe3780adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 --2- 172.21.15.94:0/443594143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b9df0 0x7fe37813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:43.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 >> 172.21.15.94:0/443594143 conn(0x7fe37806a150 msgr2=0x7fe3780b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:43.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 shutdown_connections 2024-03-18T18:26:43.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:43.942+0000 7fe37d2f9700 1 -- 172.21.15.94:0/443594143 wait complete. 2024-03-18T18:26:43.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-18T18:26:44.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 Processor -- start 2024-03-18T18:26:44.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 -- start start 2024-03-18T18:26:44.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f11840b2c70 0x7f118406ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f118413e0b0 0x7f118413e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1184147da0 con 0x7f1184073240 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11840707a0 con 0x7f11840b2c70 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1183fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1184070530 con 0x7f118413e0b0 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1182ffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1184073240 0x7f1184148230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:42318/0 (socket says 172.21.15.94:42318) 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f1182ffd700 1 -- 172.21.15.94:0/1058973515 learned_addr learned my addr 172.21.15.94:0/1058973515 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f117a7fc700 1 --2- 172.21.15.94:0/1058973515 >> v2:172.21.15.94:3300/0 conn(0x7f11840b2c70 0x7f118406ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f11837fe700 1 --2- 172.21.15.94:0/1058973515 >> v2:172.21.15.151:3300/0 conn(0x7f118413e0b0 0x7f118413e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f11827fc700 1 -- 172.21.15.94:0/1058973515 <== mon.0 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480195576 0 0) 0x7f1184147da0 con 0x7f1184073240 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f11827fc700 1 -- 172.21.15.94:0/1058973515 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11700035d0 con 0x7f1184073240 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f117a7fc700 1 -- 172.21.15.94:0/1058973515 >> v2:172.21.15.151:3300/0 conn(0x7f118413e0b0 msgr2=0x7f118413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f117a7fc700 1 --2- 172.21.15.94:0/1058973515 >> v2:172.21.15.151:3300/0 conn(0x7f118413e0b0 0x7f118413e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f117a7fc700 1 -- 172.21.15.94:0/1058973515 >> v1:172.21.15.94:6789/0 conn(0x7f1184073240 legacy=0x7f1184148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f117a7fc700 1 -- 172.21.15.94:0/1058973515 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184073620 con 0x7f11840b2c70 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.062+0000 7f117a7fc700 1 --2- 172.21.15.94:0/1058973515 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f118406ee90 secure :-1 s=READY pgs=4546 cs=0 l=1 rev1=1 crypto rx=0x7f11840b2210 tx=0x7f116c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702bf036e8a15034 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f11827fc700 1 -- 172.21.15.94:0/1058973515 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c011830 con 0x7f11840b2c70 2024-03-18T18:26:44.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f11827fc700 1 -- 172.21.15.94:0/1058973515 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f116c011990 con 0x7f11840b2c70 2024-03-18T18:26:44.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f11827fc700 1 -- 172.21.15.94:0/1058973515 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c011d40 con 0x7f11840b2c70 2024-03-18T18:26:44.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 -- 172.21.15.94:0/1058973515 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 msgr2=0x7f118406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 --2- 172.21.15.94:0/1058973515 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f118406ee90 secure :-1 s=READY pgs=4546 cs=0 l=1 rev1=1 crypto rx=0x7f11840b2210 tx=0x7f116c009b30 comp rx=0 tx=0).stop 2024-03-18T18:26:44.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 -- 172.21.15.94:0/1058973515 shutdown_connections 2024-03-18T18:26:44.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 --2- 172.21.15.94:0/1058973515 >> v2:172.21.15.151:3300/0 conn(0x7f118413e0b0 0x7f118413e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 --2- 172.21.15.94:0/1058973515 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f118406ee90 unknown :-1 s=CLOSED pgs=4546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 -- 172.21.15.94:0/1058973515 >> 172.21.15.94:0/1058973515 conn(0x7f11840b4d70 msgr2=0x7f11840b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:44.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 -- 172.21.15.94:0/1058973515 shutdown_connections 2024-03-18T18:26:44.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 -- 172.21.15.94:0/1058973515 wait complete. 2024-03-18T18:26:44.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 Processor -- start 2024-03-18T18:26:44.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.066+0000 7f1183fff700 1 -- start start 2024-03-18T18:26:44.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184073240 0x7f11841d9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f11841465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f118413e0b0 0x7f11840b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184147240 con 0x7f11840b2c70 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118413dae0 con 0x7f1184073240 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1184131190 con 0x7f118413e0b0 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f11841465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f11841465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:54748/0 (socket says 172.21.15.94:54748) 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 -- 172.21.15.94:0/3716791452 learned_addr learned my addr 172.21.15.94:0/3716791452 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1182ffd700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184073240 0x7f11841d9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f11837fe700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f118413e0b0 0x7f11840b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 -- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f118413e0b0 msgr2=0x7f11840b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f118413e0b0 0x7f11840b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 -- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184073240 msgr2=0x7f11841d9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184073240 0x7f11841d9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 -- 172.21.15.94:0/3716791452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c0094b0 con 0x7f11840b2c70 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1182ffd700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184073240 0x7f11841d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f11837fe700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f118413e0b0 0x7f11840b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T18:26:44.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117a7fc700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f11841465a0 secure :-1 s=READY pgs=4547 cs=0 l=1 rev1=1 crypto rx=0x7f116c0090b0 tx=0x7f116c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:44.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c004480 con 0x7f11840b2c70 2024-03-18T18:26:44.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f116c01f070 con 0x7f11840b2c70 2024-03-18T18:26:44.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118413d800 con 0x7f11840b2c70 2024-03-18T18:26:44.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c003920 con 0x7f11840b2c70 2024-03-18T18:26:44.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841474b0 con 0x7f11840b2c70 2024-03-18T18:26:44.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.070+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11841462c0 con 0x7f11840b2c70 2024-03-18T18:26:44.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.074+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f116c021030 con 0x7f11840b2c70 2024-03-18T18:26:44.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.074+0000 7f117bfff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1164066730 0x7f1164068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.074+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f116c0854c0 con 0x7f11840b2c70 2024-03-18T18:26:44.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.074+0000 7f1182ffd700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1164066730 0x7f1164068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.074+0000 7f1182ffd700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1164066730 0x7f1164068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11740011e0 tx=0x7f1174009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:44.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.082+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f11841462c0 con 0x7f11840b2c70 2024-03-18T18:26:44.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.286+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f11841462c0 con 0x7f11840b2c70 2024-03-18T18:26:44.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.302+0000 7f117bfff700 1 -- 172.21.15.94:0/3716791452 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f11841462c0 con 0x7f11840b2c70 2024-03-18T18:26:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1164066730 msgr2=0x7f1164068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1164066730 0x7f1164068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11740011e0 tx=0x7f1174009040 comp rx=0 tx=0).stop 2024-03-18T18:26:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 msgr2=0x7f11841465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f11841465a0 secure :-1 s=READY pgs=4547 cs=0 l=1 rev1=1 crypto rx=0x7f116c0090b0 tx=0x7f116c004770 comp rx=0 tx=0).stop 2024-03-18T18:26:44.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 shutdown_connections 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1164066730 0x7f1164068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f118413e0b0 0x7f11840b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f11840b2c70 0x7f11841465a0 unknown :-1 s=CLOSED pgs=4547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 --2- 172.21.15.94:0/3716791452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184073240 0x7f11841d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 >> 172.21.15.94:0/3716791452 conn(0x7f11840b4d70 msgr2=0x7f1184136670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 shutdown_connections 2024-03-18T18:26:44.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.306+0000 7f1183fff700 1 -- 172.21.15.94:0/3716791452 wait complete. 2024-03-18T18:26:44.312 INFO:teuthology.orchestra.run.smithi094.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-18T18:26:44.326 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-18T18:26:44.351 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2024-03-18T18:26:44.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 Processor -- start 2024-03-18T18:26:44.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 -- start start 2024-03-18T18:26:44.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa7e8146840 0x7fa7e81510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e8141000 con 0x7fa7e806a5c0 2024-03-18T18:26:44.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80b7320 con 0x7fa7e8146840 2024-03-18T18:26:44.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ee786700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e809b550 con 0x7fa7e806a9a0 2024-03-18T18:26:44.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ecd23700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa7e8146840 0x7fa7e81510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ecd23700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa7e8146840 0x7fa7e81510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.94:45172/0 (socket says 172.21.15.94:45172) 2024-03-18T18:26:44.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7ecd23700 1 -- 172.21.15.94:0/4090051248 learned_addr learned my addr 172.21.15.94:0/4090051248 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.94:54552/0 (socket says 172.21.15.94:54552) 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.446+0000 7fa7e7fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa7e806a5c0 0x7fa7e809ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.94:48246/0 (socket says 172.21.15.94:48246) 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e77fe700 1 -- 172.21.15.94:0/4090051248 >> v2:172.21.15.151:3300/0 conn(0x7fa7e8146840 msgr2=0x7fa7e81510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e77fe700 1 --2- 172.21.15.94:0/4090051248 >> v2:172.21.15.151:3300/0 conn(0x7fa7e8146840 0x7fa7e81510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e77fe700 1 -- 172.21.15.94:0/4090051248 >> v1:172.21.15.151:6789/0 conn(0x7fa7e806a5c0 legacy=0x7fa7e809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e77fe700 1 -- 172.21.15.94:0/4090051248 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80b6a60 con 0x7fa7e806a9a0 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e77fe700 1 --2- 172.21.15.94:0/4090051248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b8410 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009850 tx=0x7fa7d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56a696d84b8dd24 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:44.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e6ffd700 1 -- 172.21.15.94:0/4090051248 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8011830 con 0x7fa7e806a9a0 2024-03-18T18:26:44.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e6ffd700 1 -- 172.21.15.94:0/4090051248 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa7d8011990 con 0x7fa7e806a9a0 2024-03-18T18:26:44.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7e6ffd700 1 -- 172.21.15.94:0/4090051248 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8011d60 con 0x7fa7e806a9a0 2024-03-18T18:26:44.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 -- 172.21.15.94:0/4090051248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 msgr2=0x7fa7e80b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4090051248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b8410 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009850 tx=0x7fa7d8009b60 comp rx=0 tx=0).stop 2024-03-18T18:26:44.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 -- 172.21.15.94:0/4090051248 shutdown_connections 2024-03-18T18:26:44.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4090051248 >> v2:172.21.15.151:3300/0 conn(0x7fa7e8146840 0x7fa7e81510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4090051248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b8410 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 -- 172.21.15.94:0/4090051248 >> 172.21.15.94:0/4090051248 conn(0x7fa7e80bc040 msgr2=0x7fa7e80bc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:44.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 -- 172.21.15.94:0/4090051248 shutdown_connections 2024-03-18T18:26:44.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.450+0000 7fa7ee786700 1 -- 172.21.15.94:0/4090051248 wait complete. 2024-03-18T18:26:44.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 Processor -- start 2024-03-18T18:26:44.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 -- start start 2024-03-18T18:26:44.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 0x7fa7e809f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7e8146840 0x7fa7e80a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80b62e0 con 0x7fa7e806a5c0 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80a0ab0 con 0x7fa7e8146840 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80b5910 con 0x7fa7e806a9a0 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 0x7fa7e809f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 0x7fa7e809f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33990/0 (socket says 172.21.15.94:33990) 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 -- 172.21.15.94:0/4234781684 learned_addr learned my addr 172.21.15.94:0/4234781684 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ecd23700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7e8146840 0x7fa7e80a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e77fe700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 -- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 msgr2=0x7fa7e80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 -- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7e8146840 msgr2=0x7fa7e80a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7e8146840 0x7fa7e80a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 -- 172.21.15.94:0/4234781684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80094b0 con 0x7fa7e806a5c0 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ecd23700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7e8146840 0x7fa7e80a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e7fff700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 0x7fa7e809f210 secure :-1 s=READY pgs=4549 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c530 tx=0x7fa7dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:44.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc005cd0 con 0x7fa7e806a5c0 2024-03-18T18:26:44.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa7dc005e30 con 0x7fa7e806a5c0 2024-03-18T18:26:44.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80a19b0 con 0x7fa7e806a5c0 2024-03-18T18:26:44.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc007310 con 0x7fa7e806a5c0 2024-03-18T18:26:44.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.454+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80a1c00 con 0x7fa7e806a5c0 2024-03-18T18:26:44.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.458+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e8068310 con 0x7fa7e806a5c0 2024-03-18T18:26:44.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.458+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa7dc007470 con 0x7fa7e806a5c0 2024-03-18T18:26:44.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.458+0000 7fa7e4ff9700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa7d4066730 0x7fa7d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:44.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.458+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fa7dc0836e0 con 0x7fa7e806a5c0 2024-03-18T18:26:44.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.458+0000 7fa7e77fe700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa7d4066730 0x7fa7d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:44.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.458+0000 7fa7e77fe700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa7d4066730 0x7fa7d4068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80090b0 tx=0x7fa7d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:44.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.470+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa7dc050980 con 0x7fa7e806a5c0 2024-03-18T18:26:44.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:44.678+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa7e80a0d00 con 0x7fa7e806a5c0 2024-03-18T18:26:45.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.314+0000 7fa7e4ff9700 1 -- 172.21.15.94:0/4234781684 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa7dc053fa0 con 0x7fa7e806a5c0 2024-03-18T18:26:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa7d4066730 msgr2=0x7fa7d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa7d4066730 0x7fa7d4068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80090b0 tx=0x7fa7d8008030 comp rx=0 tx=0).stop 2024-03-18T18:26:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 msgr2=0x7fa7e809f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 0x7fa7e809f210 secure :-1 s=READY pgs=4549 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c530 tx=0x7fa7dc00c8f0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 shutdown_connections 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7fa7d4066730 0x7fa7d4068bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7e8146840 0x7fa7e80a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7e806a9a0 0x7fa7e80b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 --2- 172.21.15.94:0/4234781684 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7e806a5c0 0x7fa7e809f210 unknown :-1 s=CLOSED pgs=4549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 >> 172.21.15.94:0/4234781684 conn(0x7fa7e80bc040 msgr2=0x7fa7e8145fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 shutdown_connections 2024-03-18T18:26:45.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.318+0000 7fa7ee786700 1 -- 172.21.15.94:0/4234781684 wait complete. 2024-03-18T18:26:45.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-18T18:26:45.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 Processor -- start 2024-03-18T18:26:45.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 -- start start 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f638c09e4e0 0x7f638c1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f638c14a3b0 0x7f638c150df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c09e8c0 con 0x7f638c0999d0 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0bb1e0 con 0x7f638c09e4e0 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6392c79700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0bb4c0 con 0x7f638c14a3b0 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6391c77700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f638c09e4e0 0x7f638c1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.466+0000 7f6391c77700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f638c09e4e0 0x7f638c1404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:33998/0 (socket says 172.21.15.94:33998) 2024-03-18T18:26:45.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6391c77700 1 -- 172.21.15.94:0/3985415339 learned_addr learned my addr 172.21.15.94:0/3985415339 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:45.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392478700 1 --2- 172.21.15.94:0/3985415339 >> v2:172.21.15.151:3300/0 conn(0x7f638c14a3b0 0x7f638c150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:45.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6391c77700 1 -- 172.21.15.94:0/3985415339 >> v2:172.21.15.151:3300/0 conn(0x7f638c14a3b0 msgr2=0x7f638c150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:45.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6391c77700 1 --2- 172.21.15.94:0/3985415339 >> v2:172.21.15.151:3300/0 conn(0x7f638c14a3b0 0x7f638c150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6391c77700 1 -- 172.21.15.94:0/3985415339 >> v1:172.21.15.151:6789/0 conn(0x7f638c0999d0 legacy=0x7f638c149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:45.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6391c77700 1 -- 172.21.15.94:0/3985415339 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0bb7a0 con 0x7f638c09e4e0 2024-03-18T18:26:45.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6391c77700 1 --2- 172.21.15.94:0/3985415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c09e4e0 0x7f638c1404e0 secure :-1 s=READY pgs=4550 cs=0 l=1 rev1=1 crypto rx=0x7f638c0b8860 tx=0x7f637c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b092dd4531b10741 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:45.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6390c75700 1 -- 172.21.15.94:0/3985415339 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c011830 con 0x7f638c09e4e0 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6390c75700 1 -- 172.21.15.94:0/3985415339 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f637c011990 con 0x7f638c09e4e0 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6390c75700 1 -- 172.21.15.94:0/3985415339 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c011d40 con 0x7f638c09e4e0 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 -- 172.21.15.94:0/3985415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c09e4e0 msgr2=0x7f638c1404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 --2- 172.21.15.94:0/3985415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c09e4e0 0x7f638c1404e0 secure :-1 s=READY pgs=4550 cs=0 l=1 rev1=1 crypto rx=0x7f638c0b8860 tx=0x7f637c009bf0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 -- 172.21.15.94:0/3985415339 shutdown_connections 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 --2- 172.21.15.94:0/3985415339 >> v2:172.21.15.151:3300/0 conn(0x7f638c14a3b0 0x7f638c150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 --2- 172.21.15.94:0/3985415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c09e4e0 0x7f638c1404e0 unknown :-1 s=CLOSED pgs=4550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 -- 172.21.15.94:0/3985415339 >> 172.21.15.94:0/3985415339 conn(0x7f638c073600 msgr2=0x7f638c09db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:45.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 -- 172.21.15.94:0/3985415339 shutdown_connections 2024-03-18T18:26:45.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 -- 172.21.15.94:0/3985415339 wait complete. 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 Processor -- start 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.470+0000 7f6392c79700 1 -- start start 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f638c0999d0 0x7f638c143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638c09e4e0 0x7f638c1424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 0x7f638c1df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1defa0 con 0x7f638c14a3b0 2024-03-18T18:26:45.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c09d460 con 0x7f638c0999d0 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c143c10 con 0x7f638c09e4e0 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 0x7f638c1df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 0x7f638c1df3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34012/0 (socket says 172.21.15.94:34012) 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 -- 172.21.15.94:0/2183744597 learned_addr learned my addr 172.21.15.94:0/2183744597 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6391c77700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f638c0999d0 0x7f638c143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6391476700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638c09e4e0 0x7f638c1424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 -- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638c09e4e0 msgr2=0x7f638c1424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:45.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638c09e4e0 0x7f638c1424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 -- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f638c0999d0 msgr2=0x7f638c143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f638c0999d0 0x7f638c143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 -- 172.21.15.94:0/2183744597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c009570 con 0x7f638c14a3b0 2024-03-18T18:26:45.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392478700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 0x7f638c1df3f0 secure :-1 s=READY pgs=4551 cs=0 l=1 rev1=1 crypto rx=0x7f638400efc0 tx=0x7f638400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400cad0 con 0x7f638c14a3b0 2024-03-18T18:26:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f638400f040 con 0x7f638c14a3b0 2024-03-18T18:26:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400ce90 con 0x7f638c14a3b0 2024-03-18T18:26:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c0b5f40 con 0x7f638c14a3b0 2024-03-18T18:26:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.474+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c1429e0 con 0x7f638c14a3b0 2024-03-18T18:26:45.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.478+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c0ba2b0 con 0x7f638c14a3b0 2024-03-18T18:26:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.478+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6384014480 con 0x7f638c14a3b0 2024-03-18T18:26:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.478+0000 7f63827fc700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6370066730 0x7f6370068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.478+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f6384084be0 con 0x7f638c14a3b0 2024-03-18T18:26:45.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.478+0000 7f6391c77700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6370066730 0x7f6370068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:45.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.478+0000 7f6391c77700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6370066730 0x7f6370068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:45.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.486+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6384051f10 con 0x7f638c14a3b0 2024-03-18T18:26:45.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:45.654+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f638c1df0e0 con 0x7f638c14a3b0 2024-03-18T18:26:46.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.330+0000 7f63827fc700 1 -- 172.21.15.94:0/2183744597 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7f63840180d0 con 0x7f638c14a3b0 2024-03-18T18:26:46.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6370066730 msgr2=0x7f6370068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:46.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6370066730 0x7f6370068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c008030 comp rx=0 tx=0).stop 2024-03-18T18:26:46.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 msgr2=0x7f638c1df3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:46.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 0x7f638c1df3f0 secure :-1 s=READY pgs=4551 cs=0 l=1 rev1=1 crypto rx=0x7f638400efc0 tx=0x7f638400c0c0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 shutdown_connections 2024-03-18T18:26:46.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f6370066730 0x7f6370068bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f638c14a3b0 0x7f638c1df3f0 unknown :-1 s=CLOSED pgs=4551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638c09e4e0 0x7f638c1424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 --2- 172.21.15.94:0/2183744597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f638c0999d0 0x7f638c143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 >> 172.21.15.94:0/2183744597 conn(0x7f638c073600 msgr2=0x7f638c09db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:46.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 shutdown_connections 2024-03-18T18:26:46.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.342+0000 7f6392c79700 1 -- 172.21.15.94:0/2183744597 wait complete. 2024-03-18T18:26:46.348 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_metadata' removed 2024-03-18T18:26:46.365 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-18T18:26:46.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.494+0000 7f1f1a628700 1 Processor -- start 2024-03-18T18:26:46.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.494+0000 7f1f1a628700 1 -- start start 2024-03-18T18:26:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f1406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f14143160 0x7f1f1413d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1f141435c0 0x7f1f1413d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f14070c40 con 0x7f1f14143160 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140b4d90 con 0x7f1f141435c0 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1406ceb0 con 0x7f1f1406cad0 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f14143160 0x7f1f1413d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f14143160 0x7f1f1413d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34024/0 (socket says 172.21.15.94:34024) 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 -- 172.21.15.94:0/885661364 learned_addr learned my addr 172.21.15.94:0/885661364 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:46.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f19e27700 1 --2- 172.21.15.94:0/885661364 >> v2:172.21.15.151:3300/0 conn(0x7f1f141435c0 0x7f1f1413d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f19626700 1 --2- 172.21.15.94:0/885661364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f1406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 -- 172.21.15.94:0/885661364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 msgr2=0x7f1f1406ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 --2- 172.21.15.94:0/885661364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f1406ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 -- 172.21.15.94:0/885661364 >> v2:172.21.15.151:3300/0 conn(0x7f1f141435c0 msgr2=0x7f1f1413d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 --2- 172.21.15.94:0/885661364 >> v2:172.21.15.151:3300/0 conn(0x7f1f141435c0 0x7f1f1413d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 -- 172.21.15.94:0/885661364 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f14070960 con 0x7f1f14143160 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 --2- 172.21.15.94:0/885661364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f14143160 0x7f1f1413d050 secure :-1 s=READY pgs=4552 cs=0 l=1 rev1=1 crypto rx=0x7f1f14144290 tx=0x7f1f0400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fa8902368a4bb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:46.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f0bfff700 1 -- 172.21.15.94:0/885661364 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400dd30 con 0x7f1f14143160 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f0bfff700 1 -- 172.21.15.94:0/885661364 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1f0400de90 con 0x7f1f14143160 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f0bfff700 1 -- 172.21.15.94:0/885661364 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040106b0 con 0x7f1f14143160 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- 172.21.15.94:0/885661364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f14143160 msgr2=0x7f1f1413d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- 172.21.15.94:0/885661364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f14143160 0x7f1f1413d050 secure :-1 s=READY pgs=4552 cs=0 l=1 rev1=1 crypto rx=0x7f1f14144290 tx=0x7f1f0400be90 comp rx=0 tx=0).stop 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- 172.21.15.94:0/885661364 shutdown_connections 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- 172.21.15.94:0/885661364 >> v2:172.21.15.151:3300/0 conn(0x7f1f141435c0 0x7f1f1413d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- 172.21.15.94:0/885661364 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f14143160 0x7f1f1413d050 unknown :-1 s=CLOSED pgs=4552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- 172.21.15.94:0/885661364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f1406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- 172.21.15.94:0/885661364 >> 172.21.15.94:0/885661364 conn(0x7f1f140b5610 msgr2=0x7f1f140b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:46.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- 172.21.15.94:0/885661364 shutdown_connections 2024-03-18T18:26:46.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- 172.21.15.94:0/885661364 wait complete. 2024-03-18T18:26:46.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 Processor -- start 2024-03-18T18:26:46.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- start start 2024-03-18T18:26:46.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f140aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f14143160 0x7f1f14144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 0x7f1f141db890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141db4a0 con 0x7f1f141435c0 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14146a50 con 0x7f1f14143160 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f1a628700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14146d30 con 0x7f1f1406cad0 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f19e27700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 0x7f1f141db890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f19e27700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 0x7f1f141db890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:34036/0 (socket says 172.21.15.94:34036) 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f19e27700 1 -- 172.21.15.94:0/3747056991 learned_addr learned my addr 172.21.15.94:0/3747056991 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-18T18:26:46.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f18e25700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f14143160 0x7f1f14144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.498+0000 7f1f19626700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f140aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19e27700 1 -- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 msgr2=0x7f1f140aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19e27700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f140aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19e27700 1 -- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f14143160 msgr2=0x7f1f14144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19e27700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f14143160 0x7f1f14144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19e27700 1 -- 172.21.15.94:0/3747056991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0400b810 con 0x7f1f141435c0 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19e27700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 0x7f1f141db890 secure :-1 s=READY pgs=4553 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00efc0 tx=0x7f1f0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c009ea0 con 0x7f1f141435c0 2024-03-18T18:26:46.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1f0c00f040 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c014480 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1406fbb0 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f140b2af0 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14144a20 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 6) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1f0c0145e0 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f09ffb700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1ef8066730 0x7f1ef8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f1f0c0847a0 con 0x7f1f141435c0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19626700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1ef8066730 0x7f1ef8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T18:26:46.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.502+0000 7f1f19626700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1ef8066730 0x7f1ef8068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009ad0 tx=0x7f1f10009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T18:26:46.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.510+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1f14144a20 con 0x7f1f141435c0 2024-03-18T18:26:46.684 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:46.682+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f14144a20 con 0x7f1f141435c0 2024-03-18T18:26:47.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.346+0000 7f1f09ffb700 1 -- 172.21.15.94:0/3747056991 <== mon.0 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1f14144a20 con 0x7f1f141435c0 2024-03-18T18:26:47.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1ef8066730 msgr2=0x7f1ef8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:47.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1ef8066730 0x7f1ef8068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009ad0 tx=0x7f1f10009240 comp rx=0 tx=0).stop 2024-03-18T18:26:47.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 msgr2=0x7f1f141db890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T18:26:47.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 0x7f1f141db890 secure :-1 s=READY pgs=4553 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00efc0 tx=0x7f1f0c00c3a0 comp rx=0 tx=0).stop 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 shutdown_connections 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:6832/25889,v1:172.21.15.94:6833/25889] conn(0x7f1ef8066730 0x7f1ef8068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f141435c0 0x7f1f141db890 unknown :-1 s=CLOSED pgs=4553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f14143160 0x7f1f14144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 --2- 172.21.15.94:0/3747056991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f1406cad0 0x7f1f140aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 >> 172.21.15.94:0/3747056991 conn(0x7f1f140b5610 msgr2=0x7f1f140b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T18:26:47.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 shutdown_connections 2024-03-18T18:26:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-18T18:26:47.354+0000 7f1f1a628700 1 -- 172.21.15.94:0/3747056991 wait complete. 2024-03-18T18:26:47.359 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'cephfs_data' removed 2024-03-18T18:26:47.375 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-18T18:26:47.375 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T18:26:47.375 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:26:47.388 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T18:26:47.389 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T18:26:47.389 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:26:47.407 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T18:26:47.408 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-18T18:26:47.408 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-18T18:26:47.408 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:26:50.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-18T18:26:52.049 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:52.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:53.510 INFO:tasks.ceph.osd.0:Stopped 2024-03-18T18:26:53.510 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-18T18:26:53.510 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:26:56.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-18T18:26:56.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-18T18:26:59.612 INFO:tasks.ceph.osd.1:Stopped 2024-03-18T18:26:59.613 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-18T18:26:59.613 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:02.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-18T18:27:02.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-18T18:27:05.714 INFO:tasks.ceph.osd.2:Stopped 2024-03-18T18:27:05.715 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-18T18:27:05.715 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:08.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-18T18:27:08.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-18T18:27:11.817 INFO:tasks.ceph.osd.3:Stopped 2024-03-18T18:27:11.817 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-18T18:27:11.817 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:14.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-18T18:27:14.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-18T18:27:17.919 INFO:tasks.ceph.osd.4:Stopped 2024-03-18T18:27:17.920 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-18T18:27:17.920 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:19.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-18T18:27:19.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-18T18:27:22.110 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:22.113 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:24.022 INFO:tasks.ceph.osd.5:Stopped 2024-03-18T18:27:24.023 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-18T18:27:24.023 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:25.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-18T18:27:25.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-18T18:27:30.124 INFO:tasks.ceph.osd.6:Stopped 2024-03-18T18:27:30.125 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-18T18:27:30.125 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:30.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-18T18:27:30.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-18T18:27:36.227 INFO:tasks.ceph.osd.7:Stopped 2024-03-18T18:27:36.227 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-18T18:27:36.228 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-18T18:27:36.228 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:36.258 INFO:tasks.ceph.mgr.y:Stopped 2024-03-18T18:27:36.259 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-18T18:27:36.259 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:36.292 INFO:tasks.ceph.mgr.x:Stopped 2024-03-18T18:27:36.292 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-18T18:27:36.292 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-18T18:27:36.292 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:36.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2024-03-18T18:27:36.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-18T18:27:36.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-03-18T18:27:36.350 INFO:tasks.ceph.mon.a:Stopped 2024-03-18T18:27:36.350 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-18T18:27:36.350 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:36.403 INFO:tasks.ceph.mon.b:Stopped 2024-03-18T18:27:36.404 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-18T18:27:36.404 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T18:27:36.449 INFO:tasks.ceph.mon.c:Stopped 2024-03-18T18:27:36.449 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-18T18:27:36.449 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-18T18:27:36.471 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:27:36.471 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-18T18:27:36.773 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:27:36.773 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-18T18:27:37.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:27:37.005 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-18T18:27:37.186 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:27:37.186 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-18T18:27:37.368 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:27:37.368 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-18T18:27:37.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:27:37.614 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-18T18:27:37.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:27:37.786 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-18T18:27:37.960 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:27:37.961 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-18T18:27:38.099 INFO:tasks.ceph:Archiving mon data... 2024-03-18T18:27:38.100 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/data/mon.a.tgz 2024-03-18T18:27:38.100 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-03-18T18:27:38.107 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.UhSEIBDreK 2024-03-18T18:27:38.108 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UhSEIBDreK 2024-03-18T18:27:38.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.UhSEIBDreK 2024-03-18T18:27:38.259 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.UhSEIBDreK is 328KB 2024-03-18T18:27:38.322 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.UhSEIBDreK 2024-03-18T18:27:38.328 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/data/mon.b.tgz 2024-03-18T18:27:38.329 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-03-18T18:27:38.335 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.qmeY4miVfp 2024-03-18T18:27:38.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.qmeY4miVfp 2024-03-18T18:27:38.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.qmeY4miVfp 2024-03-18T18:27:38.483 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.qmeY4miVfp is 338KB 2024-03-18T18:27:38.546 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.qmeY4miVfp 2024-03-18T18:27:38.553 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/data/mon.c.tgz 2024-03-18T18:27:38.553 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-03-18T18:27:38.560 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.rqPyQ8ZRcb 2024-03-18T18:27:38.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rqPyQ8ZRcb 2024-03-18T18:27:38.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.rqPyQ8ZRcb 2024-03-18T18:27:38.660 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.rqPyQ8ZRcb is 338KB 2024-03-18T18:27:38.723 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.rqPyQ8ZRcb 2024-03-18T18:27:38.730 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-18T18:27:38.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T18:27:38.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T18:27:38.748 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-03-18T18:27:38.748 DEBUG:teuthology.orchestra.run.smithi094:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-18T18:27:38.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-18T18:27:38.814 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-18T18:27:38.830 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-18T18:27:38.837 INFO:tasks.ceph:Archiving crash dumps... 2024-03-18T18:27:38.839 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi094/crash 2024-03-18T18:27:38.840 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T18:27:38.856 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi151/crash 2024-03-18T18:27:38.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T18:27:38.874 INFO:tasks.ceph:Shutting down logrotate 2024-03-18T18:27:38.875 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:38.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:38.964 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:38.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:38.994 INFO:tasks.ceph:Compressing logs... 2024-03-18T18:27:38.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T18:27:39.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T18:27:41.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-18T18:27:41.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-18T18:27:41.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-03-18T18:29:03.465 INFO:tasks.ceph:Archiving logs... 2024-03-18T18:29:03.466 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi094/log 2024-03-18T18:29:03.467 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T18:29:13.522 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi151/log 2024-03-18T18:29:13.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T18:29:34.846 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-18T18:29:34.858 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-18T18:29:34.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T18:29:34.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T18:29:34.939 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-18T18:29:34.947 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-18T18:29:34.947 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T18:29:34.950 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T18:29:34.970 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-03-18T18:29:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-03-18T18:29:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:*hv01.front.sepi 44.4.53.2 2 u 49 64 377 0.069 -1.230 0.605 2024-03-18T18:29:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 377 0.097 3.787 0.508 2024-03-18T18:29:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:+hv03.front.sepi 74.6.168.72 3 u 44 64 377 0.095 6.695 0.608 2024-03-18T18:29:34.971 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-03-18T18:29:34.973 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-03-18T18:29:34.973 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-03-18T18:29:34.973 INFO:teuthology.orchestra.run.smithi151.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 64 377 0.063 0.450 1.182 2024-03-18T18:29:34.973 INFO:teuthology.orchestra.run.smithi151.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.079 5.704 1.006 2024-03-18T18:29:34.973 INFO:teuthology.orchestra.run.smithi151.stdout:+hv03.front.sepi 74.6.168.72 3 u 47 64 377 0.065 7.250 0.637 2024-03-18T18:29:34.974 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-03-18T18:29:34.974 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-18T18:29:34.983 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-18T18:29:34.983 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-18T18:29:34.992 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-18T18:29:34.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-18T18:29:35.007 INFO:teuthology.task.internal:Duration was 1835.034697 seconds 2024-03-18T18:29:35.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-18T18:29:35.016 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-18T18:29:35.016 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T18:29:35.019 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T18:29:35.071 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-18T18:29:35.071 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-03-18T18:29:35.071 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T18:29:35.082 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-03-18T18:29:35.082 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T18:29:35.095 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-18T18:29:35.096 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T18:29:35.098 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T18:29:35.176 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-18T18:29:35.176 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T18:29:35.178 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T18:29:35.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-18T18:29:35.260 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-18T18:29:35.261 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T18:29:35.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T18:29:35.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-18T18:29:35.303 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T18:29:35.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T18:29:35.318 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-03-18T18:29:35.350 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-03-18T18:29:35.377 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T18:29:35.400 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi094.front.sepia.ceph.com, flagging run as failed 2024-03-18T18:29:35.400 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T18:29:35.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:29:35.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-18T18:29:35.416 INFO:teuthology.task.internal:Transferring archived files... 2024-03-18T18:29:35.417 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi094 2024-03-18T18:29:35.417 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T18:29:35.555 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-03-18T18:29:35.888 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi094/coredump/1710786331.71858.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph_test_libcephfs_reclaim', real uid: 1000, effective uid: 1000, real gid: 1267, effective gid: 1267, execfn: '/usr/bin/ceph_test_libcephfs_reclaim', platform: 'x86_64' 2024-03-18T18:29:35.888 INFO:teuthology.task.internal: dump_program: ceph_test_libcephfs_reclaim 2024-03-18T18:29:35.889 DEBUG:teuthology.orchestra.run.smithi094:> which ceph_test_libcephfs_reclaim 2024-03-18T18:29:35.897 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/bin/ceph_test_libcephfs_reclaim 2024-03-18T18:29:35.908 DEBUG:teuthology.orchestra.remote:smithi094:/usr/bin/ceph_test_libcephfs_reclaim is 2MB 2024-03-18T18:29:35.999 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-03-18T18:29:36.006 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.ETLuAzpTRB 2024-03-18T18:29:36.006 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /usr/bin/ceph_test_libcephfs_reclaim /tmp/tmp.ETLuAzpTRB 2024-03-18T18:29:36.025 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.ETLuAzpTRB 2024-03-18T18:29:36.095 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.ETLuAzpTRB is 2MB 2024-03-18T18:29:36.181 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.ETLuAzpTRB 2024-03-18T18:29:36.188 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205/remote/smithi151 2024-03-18T18:29:36.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T18:29:36.215 INFO:teuthology.task.internal:Removing archive directory... 2024-03-18T18:29:36.215 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T18:29:36.217 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T18:29:36.258 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-18T18:29:36.269 INFO:teuthology.task.internal:Not uploading archives. 2024-03-18T18:29:36.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-18T18:29:36.308 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-18T18:29:36.308 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T18:29:36.310 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T18:29:36.316 INFO:teuthology.orchestra.run.smithi094.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 18 18:29 /home/ubuntu/cephtest 2024-03-18T18:29:36.316 INFO:teuthology.orchestra.run.smithi094.stdout: 945133 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Mar 18 18:09 /home/ubuntu/cephtest/mnt.0 2024-03-18T18:29:36.316 INFO:teuthology.orchestra.run.smithi094.stdout: 945134 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Mar 18 18:10 /home/ubuntu/cephtest/mnt.0/client.0 2024-03-18T18:29:36.316 INFO:teuthology.orchestra.run.smithi094.stdout: 1067511 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Mar 18 18:10 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-18T18:29:36.318 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-03-18T18:29:36.318 INFO:teuthology.orchestra.run.smithi151.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 18:29 /home/ubuntu/cephtest 2024-03-18T18:29:36.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T18:29:36.319 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi094 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-18T18:29:36.328 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-18T18:29:36.338 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-18T18:29:36.365 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi094 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-18T18:29:36.366 INFO:teuthology.nuke:Checking targets against current locks 2024-03-18T18:29:36.398 DEBUG:teuthology.nuke:shortname: smithi094 2024-03-18T18:29:36.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T18:29:36.423 DEBUG:teuthology.nuke:shortname: smithi151 2024-03-18T18:29:36.423 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T18:29:36.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 17:44:44.748949', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-03-18T18:29:36.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-16_15:03:17-fs-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 17:44:44.750073', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2024-03-18T18:29:36.481 INFO:teuthology.orchestra.console.smithi094:Power off 2024-03-18T18:29:36.482 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T18:29:36.505 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2024-03-18T18:29:36.506 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:36.522 INFO:teuthology.orchestra.console.smithi151:Power off 2024-03-18T18:29:36.523 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T18:29:36.533 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-18T18:29:36.547 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2024-03-18T18:29:36.547 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:36.569 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-18T18:29:40.534 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:40.570 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:40.645 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-18T18:29:40.680 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-18T18:29:44.648 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:44.680 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:44.760 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-03-18T18:29:44.791 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-18T18:29:44.861 INFO:teuthology.orchestra.console.smithi094:Power off completed 2024-03-18T18:29:48.793 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T18:29:48.904 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-03-18T18:29:49.004 INFO:teuthology.orchestra.console.smithi151:Power off completed 2024-03-18T18:29:49.110 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_20.04} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} duration: 1835.034696817398 failure_reason: 'Command failed (workunit test libcephfs/test.sh) on smithi094 with status 139: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49bdc51142759622a281d3e5327eebd07cbb8bb3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a37abbc10d5944bfb0d8923dd1918de5 status: fail success: false 2024-03-18T18:29:49.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T18:29:49.200 INFO:teuthology.run:FAIL